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PREFACE 

The  present  investigation  was  begun  in  the  Psychological  Labo- 
ratory of  the  University  of  California  in  the  spring  of  1916.  The 
experiments  in  which  children  served  as  subjects  were  conducted  in 
a  public  school  in  Oakland,  California,  while  those  upon  adults 
were,  for  the  most  part,  carried  out  in  the  Psychological  Laboratory 
of  Columbia  University. 

The  writer  has  been  fortunate  in  having  enjoyed,  during  the 
course  of  the  work,  endless  encouragement,  suggestions,  and  assis- 
tance from  a  large  number  of  people.  To  Mr.  N.  Ricciardi,  Prin- 
cipal of  the  school  visited,  I  am  indebted  for  the  privilege  of  con- 
ducting the  experiments  upon  his  charges  as  well  as  for  the  ready 
help  in  arranging  details  for  the  work.  To  the  many  teachers  whose 
class-rooms  I  invaded,  I  am  indebted  for  the  kindliest  toleration  and 
for  a  great  deal  of  valuable  assistance.  My  debt  of  gratitude  to 
Professors  G.  M.  Stratton  and  Warner  Brown  of  the  University  of 
California  and  to  Professors  J.  McKeen  Cattell,  R.  S.  Woodworth, 
E.  L.  Thorndike,  H.  L.  Hollingworth,  and  Dr.  A.  T.  Poffenberger  of 
Columbia  University,  is  very  great.  To  my  friend  Charles  E. 
Martin,  I  am  indebted  for  valuable  suggestions  and  criticisms  in  the 
preparation  of  the  manuscript. 
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INTRODUCTORY  STATEMENT  .OF  THE  PROBLEM 

The  process  of  learning  as  carried  on  by  most  adults  depending 
upon  their  native  resources  or  practical  experience,  is  frequently 
interrupted  by  attempts  at  recitation  or  volunfcuy  recall  of  what 
has  been  learned.    We  tend  to  introduce  an  attempt  art  recitation  at 
the  earliest  possible  moment,  usually  long  before  a  perfect  repro- 
duction is  possible.    In  that  case,  as  a  rule,  we  refer  pronip'tiy  to  the 
material  being  studied  in  order  to  complete  the  perusal.-;  VFor 
example,  many  years  ago  Francis  Bacon  observed,  "If  you  read  airy-, 
thing  over  twenty  times  you  will  not  learn  it  by  heart  so  easily  as 
if  you  were  to  read  it  only  ten,  trying  to  repeat  it  between  whiles, 
and  when  memory  failed  looking  at  the  book."  l    The  spontaneous 
methods  of  learning  of  many  people  resort  so  naturally  to  these 
attempted  reproductions  that  we  can  hardly  refuse  to  believe  that 
they  are  helpful.    Yet  most  of  us  would  admit  that  the  dominating 
idea  behind  such  a  procedure  is  the  fear  of  studying  the  lesson  more 
than  is  absolutely  necessary,  and  it  is  by  no  means  clear  that  intro- 
ducing the  recitation  too  early  in  the  learning  process  may  not 
result  in  loss  of  time.    This  gives  rise  to  several  practical  questions, 
such  as. — Is  an  attempted  recitation  of  as  much  value  in  learning 
as  another  perusal  or  reading,  and  is  a  recitation  at  one  stage  of  the 
learning  as  valuable  as  at  another? 

It  is  at  once  obvious  that  the  solution  of  such  questions  is  of 
tremendous  import  for  the  work  of  the  school.  It  is  imperative  that 
recall  or  recitation,  as  a  factor  in  learning,  should  be  analysed  and 
its  quantitative  importance  determined.  Although  several  studies 
of  the  problem  have  been  made  within  the  last  decade,  facts  that 
will  permit  indisputable  application  to  the  work  of  the  school-room 
are  still  wanting.  The  amount  of  experimentation  required  to  solve 
the  problem  adequately  is  much  greater  than  would  at  first  thought 
appear,  since  different  results  might  be  expected  according  to  the 
age  and  training  of  the  subject,  the  kind  of  material  employed,  the 
length  of  the  lesson  or  the  purpose  of  the  learner,  i.  e.,  whether  the 
material  is  to  be  'learned  by  heart'  or  only  partly  learned.  The 
general  condition  of  the  problem  is  indicated  by  a  recent  statement 
of  Meumann,  who,  after  summarizing  the  work  in  the  field,  con- 

'.Vomu*  Organum.  1620,  translated  by  James  Spedding,  edition  of  1863,  p.  229. 


4.  The  relation  of  the  two  methods  of  learning  as  dependent  upon  the  age  or 
school  status  of  the  learner. 

5.  The  relation  of  the  two  methods  as  dependent  upon  the  kind  of  material 
employed. 

6.  Incidental  information  concerning  the  learning  methods  of  children  and 
adults. 

In  the  next  section  a  brief  summary  of  the  work  previously  done 
on  the  problem  will  be  presented. 

*  Op.  cii.t  voL  III,  p.  130. 
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subjects.  But  as  Meumann  has  said,4  "We  do  not  know  whether 
recitation  is  of  the  same  value  for  children,  nor  whether  the  com- 
bination of  readings  and  recitations  for  optimum  results  is  the  same 
as  for  adults."  In  most  cases,  moreover,  the  earlier  researches  were 
conducted  under  rather  rigorously  controlled  conditions.  The 
subjects  were  not  permitted  to  study  in  their  habitual  manner; 
sometimes  the  material  was  presented  tachistoscopically  with  a 
fixed  tempo  of  presentation,  sometimes  articulation  was  prohibited 
or  other  restrictions  enforced.  In  the  present  work,  so  far  as  i 
practicable,  conditions  were  made  as  nearly  normal  as  possible. 
The  material  selected  is  comparable  to  that  with  which  the  pupils 
were  accustomed  to  deal  in  their  daily  work.  The  children  studied 
in  much  the  same  manner  that  they  would  employ  in  learning  a 
vocabulary,  a  spelling  lesson,  or  a  history  or  geography  lesson,  with 
the  knowledge  that  at  the  end  of  the  study  period  they  would  be 
given  a  written  examination.  Details  of  material  and  methods, 
however,  will  be  reserved  for  a  later  page. 

In  addition  to  the  experiments  upon  school  children,  adult 
subjects  were  also  tested  with  similar  materials  and  methods.  The 
data  thus  obtained  will  make  possible  a  more  adequate  comparison 
of  the  present  findings  with  those  of  other  investigations  and  will 
be  of  assistance  in  better  interpretation  of  the  results  by  virtue  of 
the  more  reliable  introspective  observations  which  would  be  ex- 
pected from  the  more  experienced  learners. 

From  this  study  it  is  hoped  that  some  information  will  be  secured 
on  the  following  points: 

1.  The  relative  value  of  learning  by  reading  as  compared  to  learning  by 
recitation. 

2.  The  differences  in  the  functions  involved  in  the  two  methods  of  learning. 

3.  The  optimum  time  at  which  to  introduce  recitation  into  the  learning 
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For  several  reasons,  it  would  be  unsafe  to  consider  Katzaroff's 
findings  as  typical.  In  the  first  place  the  results  were  obtained  from 
too  few  and  highly  trained  adults.  Individual  peculiarities  may 
play  too  prominent  a  rdle.  Moreover,  practice  effects  were  not 
sufficiently  taken  into  account,  and  finally  the  mode  of  presenta- 
tion was  not  the  same  in  the  two  methods.  During  the  perusals  by 
reading  the  total  presentation  was  visual,  but  during  recitation  oral 

TABLE  I 


Showing 

a  summary  of  results  obtained  by  Katzaroff,  op.  cit. 

Table 

Number 
of  subjects 

Number 

of  sittings 

for  each 

*  Combination 

L  reading 

R  recitation 

Test  after 

number 

hours 

Per  cent, 
correct 

Reaction 
time  in 
seconds 

A 

I 

4 

L  10  R  L5 
L  10  R  R5 

48 

43 
50 

5-6 
4.0 

B 

3 

4 

L8  L7 
L8  R7 

72 

6 
20 

8.0 
6.7 

C 

2 

4 

L8  L7 
L8  R  L6 

72 

9 
15 

7-8 
8.6 

D 

I 

3 

L4  L6 
L4  R6 
L4  RL  RL  RL 

24 

17 

46 

25 

50 
29 

45 

E 

I 

3 

L4  L6 

L4  R3  L3 

L4  RL  RL  RL 

24 

4 
62 

54 

29 
3-1 
29 

presentation  was  added  to  the  visual,  since  the  prompts  were  made 
by  means  of  the  experimenter's  voice. 

A  more  recent  experiment  by  Thorndike4  has  given  very  different 
results.  Twenty-eight  adult  students  learned  four  vocabularies  of 
twenty  pairs  each,  the  second  by  attentive  reading  and  rereading, 
the  first  by  reading  the  first  members  and  trying  to  recall  the  second 
members  of  the  pairs.  The  third  vocabulary  was  learned  in  the 
same  manner  as  the  second,  and  the  fourth  in  the  same  manner  as 
the  first.  The  results  are  given  in  Table  II. 

There  is  no  apparent  superiority  in  the  method  involving  recall ; 
in  fact,  the  method  of  reading  and  rereading  seems  to  give  slightly 
better  results.  Professor  Thorndike  explains  that  "This,  however, 
was  partly  due  to  the  overlearning  of  the  first  vocabulary,  there 

1  For  the  sake  of  brevity,  let  L  equal  reading  and  R  equal  an  attempted  recitation.  Thus  Lio 
R5  means  ten  original  readings  followed  by  five  attempted  recitations. 

*  'Repetitions  versus  Recall  in  Memorizing  Vocabularies',  Journal  of  Educational  Psychology, 
1914.  5.  PP-  59^-597. 
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ous  visual  presentaton  was  employed,  the  subjects  prompting 
themselves  and  correcting  their  own  errors.  For  the  learning  of 
syllables  and  words,  trochaic  rhythm  was  specified.  The  subjects 
were  university  graduates  and  instructors.  Each  subject  learned 
a  dozen  or  more  lessons  by  each  of  the  two  methods.  Table  HI 
gives  a  summary  of  the  results. 

Table  IV  gives  the  relation  of  reading  minus  recitation  to  recita- 
tion, computed  from  the  data  of  Table  III. 


TABLE  IV 
The  Relation  of  Reading  minus  Recitation  to  Recitation 


Tempo  controlled 

Tempo  free 

Material 

Repetitions 

Time 

Repetitions 

Time 

Average 

Median 

Average 

Median 

Average 

Median 

Average 

Median 

Veraes 
Words 
Syllables 

O.I7 
O.36 
0.6l 

0.20 
O.4O 
O.62 

O.I3 
O.31 

0.55 

O.15 

0.33 
O.56 

O.26 
O.68 
O.76 

0.28 
O.71 
O.79 

O.25 
O.44 
O.51 

O.24 
O.47 
O.52 

The  general  result  is  that  for  all  materials  recitation  is  a  more  \ 
effective  method  of  learning  than  reading  only.    Rather  striking 
individual  differences,  however,  were  found,  ranging  all  the  way 
from  certain  subjects  who  required  more  than  twice  as  long  to  learn 
a  series  of  nonsense  syllables  when  no  recitation  was  permitted,  to 
others  (in  all  three  subjects  out  of  thirteen)  for  whom  reading  was 
an  equally  or  even  more  effective  method  of  learning  than  recita- 
tion. The  latter  are  representative  of  a  peculiar  type  of  mechanical 
learners  to  whom  we  shall  refer  again.    On  the  whole,  however,  the 
advantage  of  recitation  is  clear. 

It  appears  that  the  advantage  of  recitation  differs  considerably 
according  to  the  kind  of  material  being  studied;  the  more  senseless 
and  less  connected  the  material,  the  greater  the  advantage  of 
recitation  over  reading.    Thus,  Table  IV  shows  the  superiority  of 
recitation  to  be  rather  small  in  the  learning  of  verses,  about  twice 
as  great  for  learning  series  of  words,  and  larger  still  for  learning  non- 
sense syllables.    The  advantage  of  recitation  also  differs  according 
to  the  method  of  studying  that  is  employed,  being  in  all  cases 
greater  when  the  learner  is  left  to  employ  his  own  tempo  than  when 
the  tempo  is  controlled  by  the  experimenter.     It  was  found  also 
that  in  the  reading  method  the  subjects  were  unable  to  judge  so 
well  when  the  material  was  mastered  and  often  'made  too  early  an 
attempt  to  recite*.     In  general,  it  was  found  that  the  controlled 
tempo  hampered  the  learning  to  a  greater  or  less  extent. 
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It  is  apparent  that  the  material  learned  by  recitation  is  better 
retained.  In  the  case  of  words,  material  learned  by  means  of  a 
fixed  tempo  is  not  so  well  retained  as  material  learned  by  a  free 
tempo,  but  this  result  is  not  clear  for  nonsense  material,  for  which 
the  opposite,  if  anything,  is  true. 

Three  subjects  were  each  given  twelve  tests  by  the  'Treffer' 
method  first  after  ten  minutes  and  again  with  other  material  after 
twenty-four  hours.   The  results  are  given  below. 

TABLE  VII 

Per  cent,  of  material  recalled  after  ten-minute  or  twenty-four-hour  lapses 

Studying  done  with  free  tempo 


After  ten  minutes 


Reading  33.5 

Recitation  44.1 


After  twenty-four  houra 


Reading  6 . 2 

Recitation  119 


From  this  data,  Kuhn  concludes  "the  advantage  of  learning  with 
recitation  for  retention  is  much  greater  after  a  pause  of  a  day  than 
after  a  pause  of  a  few  minutes."  7 

Kuhn  found  a  great  deal  of  interesting  information  concerning 
individual  peculiarities  in  learning.  Many  individuals  had  a  con- 
stant tendency  to  begin  to  recite  too  soon,  or  too  late,  for  the  best 
results;  some  were  unable  to  limit  themselves  to  'pure*  reading, 
more  or  less  recitation  unintentionally  creeping  in;  some  subjects 
were  found  who  seemed  to  derive  no  benefit  whatever  from  con- 
tinued readings  beyond  a  maximum  of  four  or  five;  and  others 
obtained  better  results  under  the  reading  method  than  when 
recitation  was  a  factor.  Kuhn  found  the  latter  subjects  to  employ 
a  peculiar  form  of  'automatic'  or  'mechanical*  method  of  learning, 
in  which  the  usual  method  of  building  up  associations  between 
items  and  binding  them  into  some  form  of  compact  'schema'  or 
structure  was  not  employed.  Simple  visual  imprinting  was  the 
most  effective  procedure. 

Kuhn  came  to  the  general  conclusion,  "that  recitation  is  more 
effective  because  it  leads  to  a  more  fundamental,  many-sided  work- 
ing over  of  the  material"  (p.  443).  In  recitation  the  items  are  more 
attentively  observed,  the  list  is  more  carefully  analysed,  striking 
words  are  picked  out,  and  a  better  'schema'  of  reconstruction  is 
employed.  In  the  case  of  those  individuals  who  rely  upon  the 
various  sorts  of  associative  aids  in  learning,  recitation  is  very 
helpful,  but  the  few  who  learn  mechanically  can  do  as  well  or  better 
by  merely  reading. 

»  0#.  «U  p.  466. 
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a  repetition  in  reducing  the  time  or  repetitions  needed  to  complete 
the  learning.  Table  VIII  shows  the  superiority  of  a  group  of  recita- 
tions over  an  equal  group  of  readings,  after  a  given  number  of 
preliminary  readings,  in  reducing  the  time  required  after  an  inter- 
val of  an  hour,  to  complete  the  learning  so  that  the  entire  list  could 
be  recited  without  prompts  in  ten  seconds  or  less.  The  table  is 
based  upon  the  work  of  seven  university  graduates  and  faculty 
members,  tested  three  or  four  times,  a  total  of  twenty-four  tests. 
The  table  shows  in  summary  form  a  finding  which  is  demonstrated 
in  more  detail  by  Witasek,  e.  g.,  that  the  imprinting  value  of 
successive  readings  declines  very  rapidly  after  the"  first  few.    That 


TABLE  IX  (from  Witasek,  pp.  184-185) 


Number  of 
original 
tradings 

Number  of 

additional 

readings 

Number  of 
recitations 

Total 
repetitions 

Speed  of 

recitations 

after  one  hour 

Number  of 
prompts 

6 

O 

0 

6 

78' 

7.9 

6 

5 

0 

II 

75' 

7.2 

6 

O 

5 

II 

63' 

6.3 

6 

O 

IO 

16 

69' 

5-8 

6 

IO 

0 

16 

74' 

7-5 

6 

5 

5 

16 

66' 

6.0 

6 

0 

15 

21 

66' 

5-5 

6 

15 

0 

21 

73' 

6.7 

6 

5 

IO 

21 

65' 

5-9 

6 

10 

5 

21 

66' 

5-7 

6 

10 

10 

26 

69' 

57 

6 

5 

15 

26 

65' 

6.2 

is  to  say,  readings  are  pronouncedly  subject  to  a  law  of  diminishing 
returns.  In  this  respect,  recitations  proved  to  be  a  better  form  of 
repetition.  It  is  apparent,  from  the  table,  that  recitations  intro- 
duced into  the  learning  at  almost  any  point  are  of  more  value  than 
continued  readings.  However,  the  superiority  of  recitation  seems 
to  be  somewhat  greater  when  introduced  after  six  than  when 
introduced  after  eleven  or  sixteen  readings.  This  would  seem  to 
indicate  that  recitations,  too,  are  subject  decidedly  to  the  law  of 
diminishing  returns.  But  Witasek  explains  that  in  these  particular 
tests  with  a  large  number  of  repetitions  "the  readings  unconsciously 
become  very  similar  to  recitations.' '  The  learner,  finding  the  read- 
ings to  become  more  and  more  fruitless,  is  unable  to  restrain  a 
natural  inclination  to  partially  recite. 

So  far  experiments  have  merely  confirmed  the  current  opinion 
that  recitations,  if  not  introduced  too  early  in  the  learning  process, 
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recitation  after  the  interval  of  an  hour  are  quite  different  from  those 
based  on  the  first  recitation  after  the  interval.  The  second,  fourth, 
or  fifth  recitation  would  have  shown  a  similar  difference. 

In  the  case  of  these  later  repetitions,  the  advantage  of  recitation 
as  a  factor  in  the  original  learning  is  quite  pronounced.  It  is 
apparent  also,  that  although  the  law  of  diminishing  returns  is  still 
seen  to  operate,  its  influence  is  very  much  less  marked  than  appeared 
in  the  results  for  the  first  recitation  after  the  interval. 

Table  XI  exhibits  the  results  in  terms  of  the  total  time  required 
to  learn  the  series  in  two  sittings  separated  by  an  hour. 


TABLE  XI  (from 

Witasek, 

P.  274) 

Work  of  the  first  sitting 

Work  of  the  second  sitting 

Combina- 
tion 

Time  of 
reading 

Time  of 
reciting 

Pauses 

between 

repetitions 

Time  in 
recitations 

Pauses 

between 

recitations 

Sum  with 
pauses 

Sum 

without 

pauses 

L6     Ro 

60 

0 

35 

262 

56 

413 

322 

Lu  Ro 

no 

O 

70 

236 

49 

465 

346 

L16  Ro 

160 

O 

105 

228 

42 

535 

388 

L21  Ro 

2IO 

O 

140 

202 

42 

594 

412 

L6     R5 

60 

96 

70 

H3 

28 

397 

299 

L6     Rio 

60 

166 

105 

163 

35 

529 

389 

L6     R15 

60 

206 

140 

133 

28 

567 

399 

Li  1  R5 

no 

80 

105 

145 

28 

468 

335 

Lu  Rio 

no 

119 

140 

124 

21 

514 

353 

Lu  R15 

no 

142 

175 

109 

H 

550 

36i 

L16  R5 

160 

69 

140 

142 

21 

532 

371 

L16  Rio 

160 

121 

175 

153 

28 

637 

434 

Table  XII  shows  the  data  of  Table  XI  rearranged,  the  combina- 
tions being  arrayed  in  the  order  of  their  effectiveness  with  the 
percentages  of  time  devoted  to  reading  and  to  recitation. 

The  findings  indicate  that  a  small  amount  of  work  at  the  first 
sitting  pays  better  than  a  large  amount;  that  is  to  say,  the  series 
can  be  learned  more  quickly  in  the  end  if  only  a  small  proportion 
of  the  total  time  is  devoted  to  the  first  study  while  the  larger  portion 
is  saved  for  the  review  an  hour  later.  There  is  considerable  evi- 
dence that  better  results  are  obtained  if  the  original  study  period 
is  partly  devoted  to  recitation;  for  example,  6  Ls  plus  5  Rs  gives 
better  results  than  11  Ls;  11  Ls  plus  5  Rs  is  much  better  than  16 
Ls  and  so  on.  However,  the  most  potent  factor  is  the  distribution 
of  the  recitations.  The  best  results  are  obtainable  when  the  original 
period  includes  about  twenty -five  per  cent,  of  the  total  learning 
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culty.  The  higher  grade  of  attentiveness  is  closely  correlated  with 
an  apparently  'greater  activity'  shown  during  recitation.  In  read- 
ing the  subject  is  likely  to  relax  into  a  state  of  passive  receptivity, 
in  recitation,  the  attitude  is  one  of  alert,  searching  (lsich  besinnen') 
acti^ty. 

In  an  experiment  by  Miss  Abbott,10  the  problem  has  been  attacked 
from  a  somewhat  different  point  of  view.  Miss  Abbott  endeavored 
to  determine  the  learning  types  of  a  limited  number  of  individuals 
and  to  utilize  this  information  in  the  interpretation  of  the  numerical 
results.  As  material,  lists  of  thirty  nonsense  syllables  and  sixty 
English  words  were  used.  An  apparatus  was  provided  such  that 
the  words  or  syllables  could  be  exposed  singly  for  any  time 
desired.  A  fixed  time  (sixteen  minutes)  was  allowed  for  the 
study  period,  this  time  being  divided  up  into  various  combinations 
of  reading  and  recall. 

The  groups  of  words  and  syllables  were  presented  in  various  ways 
as  shown  in  Table  XIII. 

TABLE  XIII 


a 
b 
c 
d 
c 
f 

g 
h 


First  eight  minutes 
spent  in 


visual  imprinting 


a 
11 
11 
«« 

11 
11 


visual  imprinting 

and  recall 
visual  imprinting 

and  recall 
visual  imprinting 

and  recall 
visual  imprinting 

and  recall 


Exposure 

Interval 

time  per 

between 

item 

items 

I* 

O 

i' 

0 

I' 

0 

I' 

0 

I' 

O 

Ir 

O 

I' 

0 

I' 

3' 

I' 

3' 

I* 

3' 

i' 

3' 

Interval  be- 
tween first  and 
second  learning 
period 


I' 

15' 

45' 
1' 

15' 

45' 

1' 

15' 
45' 


Second  eight  min- 
utes spent  in 


visual  imprinting 


11 
11 


Recall 
11 


11 


visual  imprinting 
and  recall 

visual  imprinting 
and  recall 

visual  imprinting 
and  recall 


All  series  were  allotted  a  sixteen-minute  study  period  except 
series  g  and  k  which  received  but  eight  minutes.  In  series  a,  b,  c, 
and  g  no  opportunity  is  given  for  recall,  the  whole  time  being  spent 
in  'Einpr§gung';    in  series  d,  e,  and  f  the  first  eight  minutes  is 

11  'On  the  Analysis  of  the  Factor  of  Recall  in  the  Learning  Process',  Psychological  Review 
Monograph,  jpop,  J  J,  pp.  iS9-i77> 
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brought  about  by  the  second  eight  minutes  of  reading  or  recall  as 
compared  to  the  results  obtained  by  the  first  eight  minutes  imprint- 
ing alone. 


TABLE  XV  (fro 
Showin  1  ike  advantage  of  lixteet 


1  Abbott,  p.   173) 
minutes  study  over  tight  m 


s™ 

, 

b 

c 

„ 

e 

f 

Subject 

Words 
Syllables 

M 

16 

18 

13 

10 
18 

—5 

V 

Wordt 
Syllables 

3 

3 
7 

8 
4 

24 

7 

3 
19 

w 

Words 
Syllables 

a 
8 

15 

8 

10 
17 

15 
17 

a 

5 
13 

X 

Word* 
Syllables 

39 
10 

50 

—4 

55 
13 

ao 

14 
6 

15 
—7 

Y. 

Table  XVI  gives  the  results  for  words  and  syllables  combined 
together  with  the  averages  for  a,  b,c;  d,e,f;  andh,  i,j,  respectively, 
based  on  the  data  from  Table  XIII. 

TABLE  XVI  (from  Abbott,  p.  174) 
Showing  the  combined  results  for  words  and  syllables 


From  Table  XV  if  appears  that  with  the  exception  of  three 
cases  the  additional  eight  minutes  of  reading  or  recall  results  in  a 
greater  amount  of  material  recalled,  and  for  all  subjects  except  Y, 
the  value  of  the  additional  study  is  more  pronounced  in  learning 
nonsense  syllables  than  in  learning  words. 

The  most  significant  comparisons  appear  in  Table  XV.  Subject 
W,  of  auditory-motor  type,  does  much  better  in  series  h,  i,  j,  than 
in  d,  e,  f,  which  in  turn  gives  better  results  than  a,  b,  c.  That  is,  the 
methods  restricting  learning  to  visual  imprinting  alone  are  the 
poorest  of  all;  the  method  giving  eight  minutes  of  imprinting 
followed  by  eight  minutes  recall  is  much  better;  while  the  method 
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Gamble.12  The  series  was  first  read  through  once,  the  subject  then 
attempted  to  recite  both  members  of  the  pairs;  the  series  was  then 
read  again,  followed  by  another  attempt  at  reconstruction  and  so 
on  until  learned.  Method  B  was  the  same  except  that,  in  recitation, 
the  first  members  of  the  pairs  were  exposed,  the  learner  attempting 
to  recite  the  second  members  only.  In  Method  C  the  subject  read 
and  reread  the  series  until  he  felt  that  they  were  mastered ;  where- 
upon he  was  tested  by  exposing  the  first  members  of  the  pair  as  in 
Method  B.  It  will  be  noted  that  Method  A  permits  the  recitation 
of  both  members  of  the  pairs,  Method  B  of  but  the  first  member, 
while  Method  C  permits  no  recitation  during  the  learning. 

In  all  methods  the  subject  read  or  recited  aloud,  the  number  of 
perusals  and  the  number  of  promptings  being  recorded.  The  scores 
are  given  in  the  form  of  the  total  amount  of  material  that  was  read 
by  the  subject  plus  the  amount  supplied  him  in  the  form  of  prompt- 
ings or  corrections  by  the  experimenter.  The  following  sample  will 
show  how  the  score  was  computed.  Suppose  a  series  of  fourteen 
syllables  is  learned  by  eight  readings  plus  seven  attempted  recita- 
tions, during  which  fifty-one  syllables  were  supplied  by  the  experi- 
menter. Then  the  total  score  would  be  eight  (the  number  of  read- 
ings) plus  fifty-one  (the  total  number  of  prompts)  divided  by 
fourteen  (the  number  of  syllables  in  the  list).     That  is,  score  = 

8  +  51/14  =  11-64- 

From  the  original  data  given  by  Knors,  the  results  shown  in 

Table  XVII  have  been  computed.     Unfortunately  Knors  did  not 

print  all  of  the  raw  data  that  he  collected,  so  that  some  of  the  tables 

are  incomplete.    The  subjects  are  three  adults  (A,  B,  C)  and  four 

children  (a,  b,  c,  d)  eleven  to  thirteen  years  of  age.     The  table 

presents  the  average  score  of  three  or  four  tests  for  each  individual. 

Although  the  results  are  somewhat  irregular,  a  few  points  can 

be  made  out.     Sections  H  and  /  indicate  that,  for  adults,  Method 

A,  which  requires  the  recitation  of  both  members  of  the  pairs,  is 

superior  to  Method  B,  in  which  but  the  second  member  is  recited. 

For  Subjects  A  and  C  the  differences  are  very  great.     The  same 

subjects,  however,  show  but  a  slight  superiority  of  Method  A  over 

Method  C  in  which  reading  alone  was  involved. 

Although  the  findings  for  the  children  are  very  irregular,  some 
differences  between  the  methods  seem  clearly  to  appear.  When 
the  series  of  nonsense  syllables  to  be  learned  is  long  (Section  L) , 
Methods  A  and  B  are  both  superior  to  C,  which  permits  reading 
only;  but  when  the  series  is  short  (Section  M)  the  differences  are 
very  small.    The  differences  between  Methods  A  and  B  in  either 

H  'A  Study  in  Memorizing  Various  Material  by  the  Reconstruction  Method',  Psychological 
Rtnew  Monograph,  1909,  IB,  No.  4- 
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Third.  The  more  reliable  experiments,  such  as  those  of  Kiihn, 
indicate  that  the  advantage  of  recitation  over  reading  is  greater  in 
learning  senseless,  non-connected  material  than  in  learning  senseful, 
connected  material. 

Fourth.  The  matter  of  the  relative  value  of  recitations  grouped, 
as  compared  to  recitations  interspersed  with  the  readings,  is  still 
an  open  question. 

Fifth.  No  satisfactory  evidence  is  at  hand  indicating  that  the 
general  results  found  for  adults  will  hold  in  the  case  of  children  of 
grammar  or  high  school  age  and  training. 

Sixth.  A  considerable,  but  not  thoroughly  convincing  amount  of 
evidence  indicates  that  the  efficacy  of  the  two  methods  of  study 
depends  entirely  upon  the  learning  or  imagery  type  of  the  individual. 

Seventh.  The  two  broad  functions,  learning  by  reading  and  learn- 
ing by  recitation,  have  not  as  yet  been  adequately  analyzed  into 
their  constituent  functions. 
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Mailer  and  Schumann.1  The  sense  material  was  constructed  by 
the  writer  from  material  found  in  J.  McKeen  Cattell's  American 
Men  of  Science  and  Who's  Who  in  America.  Samples  are  appended. 
While  this  material  is  senseful  and  connected,  the  organization  of 
different  parts  of  the  whole  is  not  so  complete  and  systematic  as 
would  be  generally  found  in  poetry  or  prose,  in  which  the  ideas  are 
more  closely  related  and  the  material  more  closely  unified  by 
rhythms,  accents,  and  natural  pauses.  This  biographical  form  of 
material  was  used  because  it  was  desirable  to  approximate  the  kind 
of  material  that  the  pupils  were  accustomed  to  study  in  their 
regular  history,  geography,  or  grammar  lessons. 

The  nonsense  syllables  were  mimeographed  in  vertical  columns  on 
cards  and  were  handed  out  one  to  each  student.  The  sense  material  was 
mimeographed  on  sheets  which  were  likewise  distributed  to  the  pupils. 

Preliminary  tests  were  conducted  in  order  to  determine  the 
amount  and  difficulty  of  the  material  to  include  in  the  lesson  as 
well  as  to  give  the  subjects  some  preliminary  practice  in  the  tests 
before  the  actual  experimentation  began.  The  kind  and  amount  of 
material  was  arranged  so  that  the  lesson  was  somewhat  too  large 
for  the  best  students  to  master  in  the  time  allotted. 

In  the  case  of  nonsense  syllables,  the  series  contained  for  the 
eighth  grade  sixteen  syllables;  for  the  sixth,  fifteen;  and  for  the 
fourth,  fourteen.  The  pupils  of  the  first  grade  were  unable  to  read 
or  write  these  syllables,  so  the  teacher  kindly  constructed  series  of 
twelve  syllables  of  a  kind  they  were  accustomed  to  manipulating, 
such  as  ad,  en,  ig,  op,  ot,  etc'  These  syllables  were  written  with  a 
black  crayon  by  the  teacher  on  large  strips  of  heavy  paper. 

The  sense  material  was  also  arranged  to  suit  the  capacities  of 
the  different  classes.  For  the  eighth  grade  the  biographies  of  five 
men  served  as  a  lesson;  for  the  sixth  and  fifth  grades,  the  same 
biographies  for  but  four  men  were  used.  For  the  fourth  grade 
easier  biographies  of  four  boys  were  used;  while  for  the  third  grade, 
the  biographies  of  three  boys  sufficed.  Samples  of  the  material  are 
appended. 

n  Tkt  Piyclalaty  of  lanint,  pp.  36S-368. 
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"When  the  learning  period  is  over  I  am  going  to  ask  you  to  write 
as  many  of  these  words  as  you  can." 

It  should  be  remembered  that  every  class  had  received  previous 
practice  in  the  learning.  The  first  grade  had  been  given  two  trial 
tests  of  five  minutes  each,  and  every  other  grade  one  or  two  trials 
of  eight  minutes  each,  the  data  from  which  were  not  used. 

Following  is  a  table  showing  the  absolute  and  relative  amounts 
of  time  devoted  to  reading  and  to  recitation  in  each  method. 

NONSENSE  MATERIAL 
Grade  one 


Method 

Time  of  reading 

Time  of  recitation 

Percent,  reading 

Per  cent,  recitation 

I 

5' 

O' 

100 

0 

2 

4' 

i' 

80 

20 

3 

3' 

2' 

60 

40 

4 

2' 

3' 

40 

60 

5 

1' 

4' 

20 

80 

Grades  four,  six,  and  eight 


I 

9' 

0 

100 

0 

2 

7  12 

1 '48' 

80 

20 

3 

5'24r 

3fc6' 

60 

40 

4 

3'36" 

5'24' 

40 

60 

5 

i'48' 

7'I2' 

20 

80 

SENSE  MATERIAL 


Grade  three 


Method 

Time  of  reading 

Time  of  recitation 

Per  cent,  reading 

Per  cent,  recitation 

I 

7>' 

0 

IOO 

0 

2 

6' 

1 '30' 

80 

20 

3 

4'30' 

3' 

60 

40 

4 

3' 

4'3<>' 

40 

60 

5 

1 '30' 

6' 

20 

80 

6 

45' 

6'45' 

IO 

90 

Grades  four,  five,  six,  and  eight 


I 

9' 

0 

100 

0 

2 

7'I2' 

1 '48' 

80 

20 

3 

5'*4' 

3'36' 

60 

40 

4 

3'36' 

5'*4' 

40 

60 

5 

i'48r 

7'I2' 

20 

80 

6 

54' 

8'o6' 

10 

90 

IV 

QUANTITATIVE  RESULTS 

It  was  pointed  out  earlier  that  the  amount  of  material  given  as  a 
lesson  was  slightly  greater  than  the  best  students  could  learn  in  the 
time  allotted.  Learning  was  never  complete,  although  in  the  case 
of  many  individuals  it  was  nearly  so.  With  nonsense  syllables  as 
material,  the  average  scores  for  the  best  methods  are  for  different 
classes  from  fifty  to  seventy-three  per  cent,  of  the  highest  possible 
score.  For  the  sense  material,  the  best  average  scores  are  in  the 
neighborhood  of  forty  per  cent,  of  the  highest  possible  scores.  This 
fact  should  be  kept  in  mind  during  the  consideration  of  the  results 
which  follow.  For  convenience  of  expression,  we  shall  speak  of 
'methods*  in  which  there  was  a  'combination  of  twenty  per  cent, 
reading  with  eighty  per  cent,  recitation',  etc.,  but  it  must  be 
remembered  that  such  expressions  have  a  strictly  local  meaning,  for 
several  reasons.  In  the  first  place,  such  'combinations'  lead  only 
to  partial  learning  of  the  data.  Perhaps  the  same  combination 
would  lead  to  very  different  results  if  applied  to  the  time  required 
to  completely  learn  the  lesson.  A  second  consideration  is  that  a 
'combination'  has  reference  only  to  the  particular  kind  and  the 
particular  amount  of  material  here  used.  The  optimum  combina- 
tion would  doubtless  be  different  according  to  the  difficulty  and 
length  of  the  lesson.  These  matters  will  be  given  more  considera- 
tion on  a  later  page. 

RESULTS  FOR  THE  LEARNING  OF  NONSENSE  SYLLABLES 

BY  CHILDREN 

Table  XVII  shows  the  results  of  the  immediate  test  for  nonsense 
syllables  in  the  form  of  average  with  P.  E.'s  computed  in  the 
manner  described  in  the  previous  chapter.  Table  XVIII  shows 
the  same  data  transformed  to  relative  scores  in  which  the  average 
of  each  class  for  all  five  methods  is  considered  ioo,  serving  as  a 
basis  for  the  other  scores.  The  P.  E.'s  were  changed  to  correspond. 
Figure  I  shows  graphically  the  data  of  Table  XVIII,  the  average 
being  denoted  by  the  heavy  line,  which  is  enclosed  within  two  light 
lines  representing  on  either  side  the  area  including  the  P.  E. 1 

For  the  fourth,  sixth,  and  eighth  grades  the  results  are  clear.  The 
results  for  Grade  one  were  a  disappointment  and  should  be  considered 

by  Profewor  J.  McKeen  CattcR. 
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FIGURE  i 


Based  an  the  data  of  Tables  XVIII  and  XIX 


Method        i 


100% 


100% 


100% 


100% 


100% 
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school  training,  would  make  the  P.  E.'s  larger.    However,  the  P. 
E.'s  are  still  very  small. 

TABLE  XIX 
Showing  the  average  percentile  scores  with  P.  E.'s  for  Grades  four,  five,  and  eight 


Method 

i 

2 

3 

4 

5 

Average  score 
P.  E. 

62.65 

I.OI 

8704 
1.88 

10359 
1.40 

110.59 
i-45 

136.09 
045 

The  following  table  shows  more  plainly  the  differences  between 
the  various  methods  and  the  P.  E.'s  of  those  differences,  the  com- 
putation being  based  on  the  preceding  table.  The  formula  em- 
ployed for  obtaining  the  P.  E.  of  the  differences  is:' 


P.  E.  diff.  -  V(P.  E.  av.)*  +  (P. 

TABLE  XX 

Shewing  the  differences  of  the  various  methods  in 

P.  E.'s  of  the  differences 

E.  av.)* 
percentages  with  the 

Differences  of  methods 

Differences  of  methods 

Differences  of  methods 

2 — i«24.39*»P.E.2.n 
3 — 1 = 40.38  **  P.  E.  1 .72 
4— 1 -47.94  *  P.  E.  1.76 
5 — 1 «  73.44  *  P.  E.  1 .10 

3—2—  1 5.99*  P.  E.  2.34 
4—2=  23.55  *  P.  E.  2.37 
5—2=  49.05  *  P.  E.  I .93 

4 — 3=  7.56*  P.  E.  2.01 
5—3=  33.06  *  P.  E.  1 .47 
5— 4=  25.50*  P.  E.  1.52 

The  differences  are  all  conspicuous  and  reliable. 

Differences  in  results  among  classes 

A  glance  at  Figure  1  will  show  that  the  findings  for  Grades 
four,  six,  and  eight  are  very  similar.  In  all  grades  Method  Five  is 
about  twice  as  good  as  Method  One.  About  the  only  difference  is 
that  the  fourth  grade  does  not  do  well,  relatively,  with  very  short 
periods  of  recitation.  The  difference  in  percentages 4  of  Method 
Two  (1'  48"  Recitation)  over  Method  One  (all  reading)  is  for  the 
eighth  grade  26.83  per  cent.,  for  the  sixth  grade  29.22  per  cent.,  for 
the  fourth  grade  17.  II  per  cent.  Grade  four  shows  the  slightest 
superiority  of  Method  Two  over  Method  One,  but  its  value  is  ren- 
dered somewhat  doubtful  since  the  sixth  grade  shows  a  slightly 
greater  superiority  than  does  Grade  eight.  Computing  the  superiority 
of  the  average  score  from  all  Methods  over  the  score  of  Method 
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for  that  grade  equals  100.  The  P.  E/s  are  computed  as  described 
above  (p.  34).  Figure  2  shows  graphically  the  data  of  Tables 
XXII  and  XXIII. 


TABLE  XXII 
Showing  the  data  of  Table  XX I  "on  a  relative  basis 


Method 


Grade  eight  Relative  score 
P.  E. 

Grade  six      Relative  score 
P.  E. 

Grade  five    Relative  score 
P.  E. 

Grade  four    Relative  score 
P.  E. 

Grade  three  Relative  score 
P.  E. 


z 

2 

3 

4 

5 

87.78 

94.62 

104.98 

105.45 

106.80 

301 

3  64 

2  93 

2.89 

2.09 

89.21 

97 -58 

106.19 

104.36 

104.77 

4.42 

348 

4.09 

4.01 

483 

80.42 

95.15 

I0375 

108.86 

10457 

2.72 

293 

3  27 

381 

3-41 

86.34 

99  94 

96.69 

in. 17 

104.13 

4-54 

4.60 

5  07 

4-54 

4-13 

74 -78 

89.29 

96.54 

121.93 

113-12 

3-35 

4.21 

421 

395 

4.81 

100.03 

3.43 

98.06 
4.01 

107.36 

3.75 

101.65 
4.18 

104.40 

4.64 


A  glance  will  show  that  the  results  here  obtained  differ  from  those 
received  with  nonsense  material.  In  general  the  advantage  of 
reading  with  recitation  as  compared  to  reading  alone  is  less  great. 
Moreover  it  appears  that  introducing  the  recitation  too  early  proves 
to  be  of  no  value;  in  fact,  for  the  lower  grades  it  may  prove  to  be  a 
positive  hindrance.  This  point  will  be  taken  up  later.  All  grades 
agree  in  showing  reading  alone  to  be  a  poor  method  of  study,  while 
a  combination  of  forty  per  cent,  reading  with  sixty  per  cent,  recita- 
tion seems  to  give  best  results. 

The  following  table  (XXIII)  shows  the  average  results  for  all 
classes  combined,  with  the  P.  E.;  the  methods  of  computation 
being  the  same  as  those  previously  described. 

TABLE  XXIII 


Showing  the  average  percentile  (rek 

itive)  score 

for  all  grades  combined 

Method 

1 

2 

3 

4 

5 

6 

Relative  score 
P.  E. 

8371 
1.64 

95  32 
099 

101 .63 
1.26 

110.35 
I.9O 

IO6.67 
I.OI 

102.30 
O.74 

In  the  average  results,  Method  Four  seems  to  be  distinctly  superior 
to  Method  Three  and  possibly  superior  to  Methods  Five  and  Six.   In 
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FIGURE  2 
Based  on  the  data  of  Tables  XXII  and  XXIII 
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per  cent,  reading)  is  as  good  as  any  other,  but  for  Grades  three  and 
four,  Method  Three  is  considerably  inferior  to  Methods  Four,  Five, 
or  Six.  For  Grade  three  the  superiority  of  Method  Four  over  Method 
Three  is  25.39  P^T  cent-  *  P-  E.  5.65;  for  rade  Gfour,  14.48  per  cent. 
^  P.  E.  6.70.  Grade  five  lies  between  the  extremes,  showing  a 
small  (5. 1 1  per  cent.)  but  scarcely  reliable  superiority  of  Method 
Four  over  Method  Three.  This  difference  cannot  easily  be  accounted 
for,  precisely,  with  the  evidence  at  hand.  It  is  probably  due  to  the 
greater  experience  of  the  more  advanced  students  in  learning 
material — history,  geography,  and  other  lessons — in  which  reading 
plays  a  very  important  part.  By  virtue  of  this  experience,  the 
older  children  were  more  skillful  in  employing  the  most  fruitful 
methods  of  attack  in  reading  which  virtually  amounted  to  less  pure 
reading,  i.  e.,  reading  which  was  in  some  degree  recitation.  The 
younger  children  stuck  more  strictly  to  pure  reading.  These 
matters,  however,  must  be  waived  to  a  later  consideration.  It  is 
only  necessary  here  to  suggest  that  such  class  differences,  whatever 
the  explanation  for  them  may  be,  are  of  marked  pedagogical 
importance. 

Summary  of  Results  for  Sense  Material 

1.  In  general,  best  results  are  obtained  by  introducing  recitation 
after  devoting  about  forty  per  cent,  of  the  time  to  reading.  Intro- 
ducing recitation  too  early  or  too  late  leads  to  poorer  results. 

2.  In  general,  the  optimum  combination  of  reading  and  recita- 
tion, under  the  conditions  of  the  present  tests,  shows  a  superiority 
over  reading  alone  by  about  thirty  per  cent. 

3.  The  lower  grades  differ  from  the  upper  grades  in  three  respects. 

a.  The  advantage  of  the  best  combination  of  reading  and 
recitation  over  the  method  of  learning  by  reading  alone  is  twice 
as  great  for  the  lower  grades,  the  average  for  grades  three  and 
four  being  35.99  per  cent,  as  compared  to  18.00  per  cent,  the 
average  for  grades  six  and  eight. 

b.  Introducing  recitation  earlier  than  the  stage  indicated  in 
(1)  above,  had  a  disadvantageous  effect  upon  the  learning  of  the 
lower  grades,  but  little  or  no  ill  effect  upon  the  work  of  the  upper 
grades. 

c.  The  upper  grades,  in  comparison  with  the  lower,  learn  more 
effectively  under  the  methods  involving  a  relatively  large  amount 
of  reading. 

RESULTS  AS  REGARDS   RETENTION  OF  NONSENSE  MATERIAL 

Tests  for  retention  of  nonsense  syllables  were  given  from  three  to 
four  hours  after  the  learning  period,  the  exact  intervals  varying  for        •    ^ 
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TABLE  XXVI 
Showing  the  data  of  Table  XXV  on  a  relative  basis 


Method 

X 

2 

3 

4 

5 

Grade  eight 

Relative  score 

47.65 

85.20 

9273 

119. 14 

155.46 

P.  E. 

2.85 

530 

387 

455 

598 

Grade  six 

Relative  score 

47.37 

64.49 

89.70 

"3. 95 

184.60 

P.  E. 

4.07 

4.88 

6.5I 

7.42 

10.76 

Grade  four 

Relative  score 

41.01 

69.21 

98.12 

124.32 

167.45 

P.  E. 

4.44 

655 

6.20 

5-49 

6.20 

Grade  one 

Relative  score 

116. 81 

91.88 

IO3.48 

97.68 

90.14 

P.  E. 

5.22 

6.O6 

6.09 

522 

783 

TABLE  XXVII 

Method 

I 

2 

3 

4 

5 

Relative  score — average  for  Grades 

four,  six,  and  eight 

45.34 

72.06 

9353 

1 19.13 

169.17 

P.  E. 

1. 19 

332 

1.34 

1.92 

447 

Table  XXVIII   following  shows  the  differences  between   the 
various  methods  computed  from  Table  XXVII. 


TABLE  XXVIII 
Shewing  the  differences  between  the  various  methods  with  P.  E.'s  of  the  differences 


Differences  of  methods 


2 — i  -27.62  =*  P.  E.  3.51 
3—1  »48.i9*P.  E.  1.78 
4— 1-74.79  *  P.  E.  2.25 
5— 1  -80.75  *  P.  E.  4.58 


Differences  of  methods 


3—2  =  20.57  =*=  P.  E.  3.60 
4 — 2  =46. 1 7=*=  P.  E.  3.87 
5—2-96.21  *P.  E.  5.56 


Differences  of  methods 


4—3=25.60*  P.  E.  2.34 
5— 3  =7564  =*=  P.  E. 4.62 
5—4  =  50.04  =*=  P.  E.  4.84 


The  steps  from  Method  One  to  Method  Five  are  all  large  and 
reliable.  Nearly  four  times  as  much  is  recalled  when  the  learning 
was  predominantly  recitation  (Method  Five)  as  when  it  was  entirely 
reading  (Method  One).  As  the  amount  of  recitation  increases  the 
amount  recalled  becomes  greater.  This  increase  in  the  amount 
recalled  is  fairly  uniform  with  the  exception  of  the  comparatively 
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difference  that  the  superiority  of  the  methods  involving  recitation 
is  much  greater. 

RESULTS  AS  REGARDS   RETENTION  OF  SENSE  MATERIAL 

Tests  for  retention  of  the  sense  material  were  given  from  three 
to  four  hours  after  the  learning  tests,  the  time  always  being  the 
same  for  each  class.  The  names  of  the  individuals  whose  biogra- 
phies had  been  studied  were  written  on  the  board  and  the  pupils 
were  asked  to  write  all  they  could  remember  about  each  person. 
Ample  time  was  given. 

TABLE  XXX 
Showing  the  data  of  Table  XXIX  on  a  relative  basis 


Method 


Grade  eight   Relative  score 
P*E. 

Grade  six       Relative  score 
P.  E. 

Grade  five     Relative  score 
P.  E. 

Grade  four     Relative  score 
P.  E. 

Grade  three   Relative  score 
P.  E. 


z 

3 

3 

4 

5 

79.58 

96.26 

126.88 

I3O.87 

128.71 

3.06 

4.14 

381 

447 

3  89 

74  31 

78.70 

112.97 

122.76 

118.73 

3  93 

365 

5.48 

548 

566 

71.06 

81.26 

104.16 

121.70 

106.93 

2.71 

2.90 

389 

4.42 

360 

79.29 

94.61 

100.10 

II6.25 

107.24 

5  04 

453 

4.84 

6.28 

4.84 

62.33 

7650 

107.08 

123.35 

116.66 

4  7i 

5  10 

5-37 

563 

5  76 

120.58 

4.89 

101.73 
5  20 

115-16 

3  90 

102.48 

4  84 

114. 17 
4-45 


Table  XXIX  shows  the  results  for  the  various  grades  in  the  form 
of  averages  with  P.  E.'s  computed  as  before.  Table  XXX  gives  the 
same  data  on  a  relative  basis.  Figure  3  gives  the  data  of  Tables 
XXX  and  XXXI  in  graphic  form. 


TABLE  XXXI 

Showing  the  average  of  the  results  for  all  grades 

Method 

1 

2 

3 

4 

5 

6 

Average 
P.  E. 

73  3i 
1  93 

8544 
245 

110.23 

2.83 

122.98 
1-43 

115  65 
2.46 

IIO.82 
2.27 

Table  XXXII  following  shows  the  differences  between  the  vari- 
ous methods  with  the  P.  E.  of  the  differences,  computed  from  the 
data  of  Table  XXXI. 
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superiority  of  Method  Three  over  the  others,  is  somewhat  greater 
than  the  data  show  in  two  cases.  Subject  Bs.  had  completely 
learned  the  series  in  8' 42"  under  Method  Three  and  Subject  Dn. 
had  completed  the  learning  some  time  (exact  amount  not  known) 
before  the  end  of  the  ten-minute  period. 

Great  individual  differences  appear  with  regard  to  the  number 
of  repetitions  made  during  the  ten-minute  study  period.  The 
average  number  of  repetitions  when  the  learning  was  entirely  by 
means  of  reading  was  forty,  with  a  mean  variation  of  fourteen. 
The  extreme  rates  were  those  of  Subject  Bs.  with  twenty-two 
repetitions  and  Gl.  with  sixty-eight,  or  three  times  as  many  as  Bs. 
Method  Two  shows  similar  individual  differences  in  the  learning  by 
reciting  as  well  as  by  reading.  The  average  number  of  repetitions 
for  five-minute  reading  being  eighteen  with  a  M.  V.  of  5.2  and  for 
five-minute  recitations  the  average  number  is  thirteen  with  a  M.  V. 
of  5.06.  The  average  figures  also  show  that  the  rates  of  repetition 
were  less  for  learning  by  reciting  than  for  learning  by  reading, 
although  as  far  as  this  test  is  concerned,  the  difference  may  be 
taken  to  mean  merely  that  the  repetitions  in  the  last  half  of  a 
period  of  learning  are  longer  than  those  of  the  first  half.  That  the 
former  interpretation  is  more  likely  to  be  the  correct  one  is  indicated 
by  the  fact  that  the  sum  of  the  repetitions  for  the  all  reading  test 
(Method  One)  is  greater  than  for  the  half  reading,  half  recitation 
test  (Method  Two),  i.  e.t  forty  as  compared  to  thirty-one.  This 
greater  speed  of  repetitions  in  the  reading  portion  of  Method  Two 
is  shown  by  fourteen  of  the  fifteen  individuals.  Method  Three 
shows  the  same  situation,  the  total  number  of  repetitions  here 
being  twenty-two,  with  rather  wide  differences  among  individuals. 

More  Intensive  Work  with  Nonsense  Syllables 

Somewhat  more  extensive  work  was  done  with  two  graduate 
students,  more  skilled  in  introspective  observation.    Each  of  these 
subjects  was  given  several  preliminary  tests  to  insure  an  acquain- 
tance with  the  procedure  and  to  eliminate  practice  effects  to  some 
extent,  before  the  main  experiment  was  begun.    Series  of  twenty 
nonsense  syllables  were  studied  for  eight  minutes  according  to  six 
different  methods.    Three  tests  were  made  by  each  method,  and  in 
each  case  the  number  and  duration  of  the  repetition  were  noted  by 
the  writer  who  kept  the  time  with  a  stop  watch.    But  one  test  was 
made  on  a  single  day.    A  recall  test  was  made  after  approximately 
six  hours  for  Subject  5  and  after  twenty-four  hours  for  Subject  T. 
The  following  table  gives  the  results  in  detail.8    The  data  were 

•  The  daratfons  of  the  repetitions  are  not  presented  here,  but  will  be  mentioned  in  a  later 
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While  this  experiment  is  far  from  being  extensive  enough  to  be 
decisive,  it  is  suggestive.  The  subjects  were  well  habituated  to  this 
kind  of  learning,  having  previously  learned  nearly  thirty  series  of 
nonsense  syllables.  Both  agree  in  showing  that  lists  of  words  can 
be  more  readily  learned  by  a  method  which  permits  recitation,  but 
the  difference  between  the  methods  is  not  so  pronounced  as  was 
found  with  nonsense  syllables.  For  Subject  S,  in  learning  nonsense 
syllables,  Method  Four  was  related  to  Method  One  as  two  to  one; 
for  Subject  T  the  ratio  was  nearly  three  to  one;  while  for  lists  of 
meaningful  words  the  ratios  of  the  corresponding  methods  are  for 
Subject  5  about  one  and  seven-tenths  to  one,  for  Subject  Tone  and 
five-tenths  to  one.  The  retention  tests  for  series  of  words  show  a 
similar  ratio,  although  the  data  are  too  few  for  reliable  results. 

Experiments  with  Connected  Sense  Material 

Subject  T  endeavored  in  six  different  tests  of  ten  minutes  each 

to  learn  twenty-line  stanzas  of  poetry  from  Goldsmith's  'Deserted 

Village',  according  to  three  different  methods.       Recall  of  the 

material  was  attempted  after  six  hours.     The  results  show  the 

number  of  words  learned  or  remembered. 

TABLE  XXXVI 


Method  One 
10'  L 

Method  Three 
S'L  s'R 

Method  Four  . 

Combinations 

Repeti- 
tions 

Score 

Repetitions 

Score 

Repetitions 

Score 

L 

L 

R 

L 

R 

First  series 
Second  series 

Average 

II 

12.5 

78 
86 

82 

6 
5 

4 
5 

93 
106 

99  5 

3 
3 

7 
8 

s4 
108 

96 

Recall  after  six  hours 


First  series 

44 

66 

Second  series 

53 

58 

58 

Average 

495 

62 

58 

The  advantage  of  the  methods  including  recitation  over  the 
reading  method  is  apparent  although  not  very  large  in  both  the 
immediate  and  the  delayed  memory  test.  The  method  employing 
fifty  per  cent,  reading  and  fifty  per  cent,  recitation  seems  to  be 
quite  as  good  as  the  method  permitting  seventy-five  per  cent. 
recitation.    The  results,  of  course,  are  too  few  to  be  more  than 
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GENERAL  SUMMARY 

Nonsense  Material 

I.  In  general,  recitation,  after  a  few  initial  readings,  is  of  much 
more  value  in  learning  than  more  reading. 

a.  Under  the  conditions  of  the  present  experiment  a  method 
devoting  the  first  twenty  per  cent,  of  the  time  to  reading  followed 
by  eighty  per  cent,  recitation  will  result  in  learning  for  immediate 
reproduction  twice  as  much  material  as  will  a  method  of  reading 
only. 

b.  As  measured  by  recall  three  to  four  hours  later,  the  difference 
between  the  two  methods  is  about  twice  as  great;  four  times  as 
much  being  recalled  under  the  recitation  method  as  under  the 
reading  method. 

2.  After  a  certain  amount  of  initial  reading  (one  minute  and 
forty-eight  seconds  or  twenty  per  cent,  of  the  total  time  in  this 
experiment)  the  more  quickly  the  recitation  is  introduced  the 
better  the  results  as  measured  by  either  immediate  or  delayed 
recall. 

3.  No  conspicuous  differences  appear  between  the  results  for 
adult  subjects  and  children  or  between  the  various  grades  with  the 
exception  that  the  findings  for  the  first  grade  differ  from  all  others. 

Sense  Material 

1.  In  general  the  best  results  are  obtained  from  a  method  devot- 
ing about  forty  per  cent,  of  the  time  to  reading  followed  by  an 
equal  amount  of  recitation. 

2.  In  general,  the  optimum  combination  of  reading  and  recita- 
tion produces  in  immediate  tests  results  superior  by  about  twenty- 
seven  per  cent,  to  those  obtained  from  reading  only. 

a.  The  difference  shown  by  recall  three  or  four  hours  later  is 
nearly  twice  as  great  as  that  shown  in  the  immediate  test. 

3.  In  most  respects  the  results  for  adults  and  for  the  various 
grades  are  very  similar. 

4.  In  certain  respects  differences  between  the  grades  were  found 
on  the  basis  of  the  results  of  immediate  tests. 

a.  The  advantage  of  the  best  methods  over  the  poorest  is 
much  greater  in  the  lower  grades  than  in  the  upper,  e.  g.t  the 
average  advantage  for  grades  three  and  four  of  the  best  method 
over  the  poorest  is  35.99  per  cent,  as  compared  to  18  per  cent., 
the  average  for  Grades  six  and  eight. 
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the  superiority  of  recitation  over  reading  found  by  Kuhn  is  very 
similar  to  that  found  in  the  present  work,  for  each  of  the  several 
materials  used.  Kiihn's  conclusion  (p.  422),  "By  the  majority  of 
people  [adults]  recitation  is  much  better  than  readings,  and  the 
relative  advantage  is  greater,  the  more  senseless  the  material,"  is 
verified  by  the  present  results  with  children  as  well  as  adult 
subjects. 

With  regard  to  the  present  finding  that  the  superiority  of  recita- 
tion over  reading  is  greater  when  measured  by  delayed  than  by 
immediate  recall,  but  little  evidence  has  been  produced  by  the 
earlier  studies.  But  the  results  that  are  available  seem  to  be  in 
harmony  with  the  present  findings.  For  example  Kuhn  found 
(see  p.  8)  that  a  lesson,  although  learned  in  very  much  less  time 
by  means  of  recitation  than  by  reading  alone,  was  retained  much 
better  and  that  the  superiority  of  recitation  in  this  respect  became 
greater  the  longer  the  retention  test  was  delayed. 

The  matter  of  individual  differences  deserves  consideration. 
Abbott  in  experiments  upon  five  subjects  found  one  among  these 
for  whom  reading  was  a  better  method  of  learning  than  recitation 
and  Kuhn  found  the  same  in  the  case  of  three  out  of  thirteen 
subjects.  Both  investigators  found  that  such  learners  employed  a 
'purely  mechanical'  form  of  learning  or  were  of  very  strong  visual 
type — such  that  best  results  were  obtained  when  the  subject  simply 
'looks  at  a  word  and  lets  it  soak  in*.  Abbott  concludes,  "We  must 
go  back  to  the  type  of  the  individual  to  explain  the  processes  and 
relative  efficiency  in  recall."  This  matter  of  learning  types  will  be 
taken  up  in  more  detail  in  the  next  section.  For  the  present,  while 
there  is  no  intention  of  contending  that  such  extreme  types  as 
those  found  by  Abbott  and  Kuhn  do  not  exist,  the  present  work 
indicates  that  they  are  in  no  wise  numerically  so  prominent  as  their 
findings  would  suggest.  While  Kuhn  found  three  among  thirteen 
subjects,  and  Abbott  one  among  five,  in  the  present  work,  tests 
upon  fifty  or  more  adults  made  under  less  artificial  conditions  have 
not  produced  a  single  case  of  such  'mechanical*  or  'strongly 
visual'  types.  In  no  case  has  the  method  of  learning  by  reading 
given  better  results  than  a  method  in  which  recitation  was  also  a 
factor.  Unfortunately,  the  data  of  the  children  cannot  be  employed 
on  this  point  with  assurance,  for  the  reason  that  the  effects  of  a 
particular  method  in  the  case  of  any  individual  may  be  marked  by 
practice  effects,  differences  in  texts,  and  the  like.  However,  in  spite 
of  all  these  differences,  an  examination  of  the  individual  data  shows 
that  exceptions  to  the  general  rule  that  recitation  is  more  effective 
than  reading  are  very,  very  rare.  This  fact  has  a  very  important 
pedagogical  significance,  since  it  gives  assurance  that  such  appli- 
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cations  as  follow  from  a  study  such  as  the  present  one,  may  be 
made  by  the  teacher  to  her  pupils  as  a  whole  without  working  a 
hardship  on  more  than  a  very  few  if  any  individuals. 

Further  considerations  of  interest  to  pedagogy,  such  as  the  opti- 
mum point  of  introducing  the  recitation  in  the  case  of  various 
materials,  and  the  efficacy  of  various  minor  functions  employed  in 
learning,  will  be  treated  in  more  detail  in  the  next  two  sections. 
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as  subjects.  Lists  of  sixteen  nonsense  syllables  were  used  as  mater- 
ial. All  the  subjects  studied  at  the  same  time,  half  of  them  by  the 
reading  method  first  and  half  by  the  recitation  method  first.  Later 
another  experiment  was  given  in  which  each  used  the  other  method. 
Five  minutes  were  devoted  to  the  study  and  the  syllables  were 
written  down  immediately  afterwards.  The  subjects  were  then 
asked  to  indicate  those  whose  positions  they  felt  certain  were 
correct,  those  which  were  doubtful,  and  those  which  they  were 
sure  were  incorrect  in  position.  They  were  then  asked  to  describe 
the  means  or  cues  by  which  they  made  their  judgments.  The 
results  are  shown  in  Table  XXXVIII. 

It  should  first  of  all  be  noted  that  almost  exactly  twice  as  high  a 
score  was  obtained  by  the  recitation  method,  and  this  introduces  a 
factor  which  tends  to  produce  a  better  showing  in  the  matter  of 
accurate  localization  for  the  reading  method.  It  will  be  noticed, 
for  example,  that  many  subjects  in  the  reading  series  were  certain 
of  the  positions  of  only  two  or  three  syllables,  which  were  in  nearly 
every  case  the  first,  or  the  first  and  second,  and  the  last.  It  is  well 
known  that  the  first  and  last  syllables  are  the  easiest  to  learn  and 
to  localize.    In  the  reading  series  these  two  or  three  syllables  form 

TABLE  XXXVIII 


Results  given  in 

the  absolute  number  of  syllables 

Reading 

Subject 

Judged 

Really 

Correct 

Doubtful 

Wrong 

Correct 

Wrong 

Score 

Ln. 

2 

2 

O 

I 

3 

7 

Sa. 

3 

2 

O 

2 

3 

13 

So. 

3 

4 

I 

4 

4 

17 

Ms. 

2 

1 

2 

2 

3 

13 

J.  M. 

7 

2 

O 

6 

3 

19 

Tr. 

3 

2 

I 

2 

4 

11 

Wr. 

2 

2 

2 

3 

3 

10 

Cc. 

4 

2 

I 

5 

2 

16 

Py. 

9 

0 

0 

5 

4 

21 

Gl. 

4 

4 

O 

3 

5 

14 

Mo. 

6 

4 

0 

7 

3 

23 

An. 

6 

3 

O 

4 

5 

18 

At. 

11 

2 

O 

9 

4 

32 

Rs. 

6 

2 

O 

5 

3 

16 

Average 

4  85 

2.79 

O.5O 

4.14 

35 

16.4 

Percent. 

59  * 

34  3 

6.3 

54-2 

45-8 
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learning  may  well  be  doubted.  At  all  events,  the  greater  freedom  to 
employ  any  method  that  seems  desirable  is  a  notable  characteristic 
of  learning  by  recitation. 

PATTERNS  AND  GROUPINGS 

Closely  connected  with  the  previous  finding  that  recitation  leads 
to  better  articulation,  accentuation,  pauses,  vocal  inflections,  use  of 
melody  and  rhythms,  as  well  as  to  better  localization,  noting  of 
peculiarities  and  meanings  in  the  material,  is  the  finding  that 
recitation  tends  more  toward  a  division  and  grouping  of  the  mater- 
ial. In  reading,  the  syllables  are  handled  more  as  isolated  terms; 
the  learner  tries  to  imprint  each  by  itself.  In  recitation  more  of  an 
attempt  is  made  to  make  the  material  over  into  some  sort  of  pattern, 
a  more  or  less  highly  organized  structure.  The  patterns  differ 
greatly  among  individuals  and  vary  according  to  the  list  of  syllables 
used.  Very  often  the  structure  is  decidedly  of  a  rhythmic  character, 
associations  being  formed  between  accented  terms,  their  positions 
and  pauses,  as  we  have  seen.  In  these  cases  the  associations  between 
members  of  a  given  foot  are  particularly  strong,  and  the  feet,  al- 
though they  are  in  the  beginning  relatively  independent,  are  bound 
together  in  various  ways.  Sometimes  the  groups  are  of  unequal 
length,  being  determined  by  the  location  of  syllables  which  for 
various  reasons  stand  out  prominently.  More  often,  of  course,  the 
groups  are  of  equal  size,  including  from  two  to  six  syllables,  usually 
three  or  four. 

Subjects  report  that  this  active  process  of  dividing  up  the  material 
and  making  it  over  into  groups  is  more  easily  done  in  recitation.  It 
is,  however,  very  often  done  in  reading  also,  but  it  is  then  more 
difficult  to  do;  the  divisions  cannot  be  made  so  sharply,  and  the 
ease  of  reading  down  the  series  defeats  their  purpose.  For  example, 
one  subject  (Bn)  whose  results  were  very  poor  in  the  reading  tests, 
said:  "A  certain  amount  of  reading  is  valuable  to  get  acquainted 
with  the  material  and  to  frame  up  a  method  of  attack,  but  there- 
after it  seems  to  do  me  no  good.  I  simply  can't  learn  by  more 
reading,  except  by  taking  a  small  bit  of  the  series,  giving  it  special 
attention  at  one  time  and  later  going  through  it  very  hurriedly. 
The  desire  to  look  away  from  the  paper  to  see  if  I  can  recite  the 
material  is  well  nigh  irresistible."  This  'going  through  it  very 
hurriedly',  which  the  subject  speaks  of,  is  probable  a  very  close 
approach  to  recitation. 

It  thus  appears  that  in  the  reading  series  the  material  is  handled 
more  by  separate  items  than  by  groups.  Less  effort  is  used  to  build 
up  a  structural  whole — there  is  less  organization  of  the  material. 
Subjects  S  and  T  show  in  another  way  an  advantage  of  recitation 
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purpose  of  building  up  associations  between  the  various  groups  of 
items  and  perfecting  the  organization  of  the  whole  structure. 

G.  E.  Miiller,4  who  has  made  an  extensive  study  of  learning 
methods,  describes  in  the  course  of  memorizing  series  of  digits,  non- 
sense syllables,  etc.,  several  stages  in  the  organization  and  grouping 
of  the  material.  With  simultaneous  presentation,  the  first  stage  is 
a  'collective  apprehension'  of  the  row  of  items.  This  stage  affords 
opportunity  to  secure  an  acquaintance  with  the  material  generally 
and  to  observe  such  near-lying  cues  as  there  may  be  that  can  be 
employed  in  dividing  up  the  material  for  further  learning.  A 
second  stage  is  called  'collective  successive  apprehension',  which 
consists  of  'a  speedy  perusal  of  the  individual  members  of  the  com- 
plexes with  attention'.5  The  result  is  that  'the  two  successive 
members  of  one  and  the  same  group  are  bound  together  by  associa- 
tions stronger  than  the  associations  between  successive  members  of 
different  groups'.  This  is  followed  by  a  third  stage,  which  consists 
of  an  'inner  reconstruction'  of  the  earlier  apprehended  groups. 
Usually  recitation  is  the  chief  constituent  of  the  third  stage.  The 
subject  endeavors  to  reproduce  the  material  without  looking  at  it, 
and  this  lead?  to  the  employment  of  the  various  kinds  of  aids  that 
have  been  previously  mentioned.  The  learner  must  select  the 
bonds  that  are  requisite  to  reproduction  and  exercise  them  until, 
once  set  into  operation,  they  will  run  their  course  without  external 
assistance.  Of  course,  during  the  recitation,  references  may  be 
made  to  the  text  for  purposes  of  prompting  as  well  as  for  review  of 
material  already  partly  learned.  But  the  'inner  reconstruction'  of 
the  material  is  the  important  function.  Kuhn  observed  as  the  most 
serious  deficiency  of  learning  by  reading  the  almost  unavoidable 
tendency  to  neglect  many  of  the  functions  which  are  essential  to 
recall,  functions  which  as  a  rule  can  operate  only  in  voluntary 
recall.  He  writes:6  "Therefore  we  come  to  the  conclusion  that 
recitation  is  better  because  it  leads  to  a  more  fundamental,  many- 
sided  working-over  ('Verarbeiten')  of  the  material." 

The  typical  learner,  we  have  seen,  breaks  up  the  material  into 
smaller  groups  which  are  dealt  with  as  units.  Similar  to  the  present 
findings,  Kuhn  noted  that  such  manipulation  of  the  material  was 
more  characteristic  of  recitation.  He  states:  "By  learning  with 
recitation  the  construction  of  groups  can  be  carried  on  more  readily 
than  through  reading.  Many  persons  say,  in  fact,  that  in  really 
pure  reading  such  a  construction  of  groups  is  impossible."7 

*'Zw  Analyse  der  Gedachtnistatigkeit  und  des  Voretellungsverlaufes',  Zeitschrift  fUr  Psy~ 
cWofw,  191 1,  Supplementary  vol.  5,  pp.  253-403. 

*lbid.,  p.  254. 

*Dber  Einpragung  durch  Leaen  und  durch  Rezitieren',  Zeitschrift  fUr  Psychologic,  1914,  68, 
P-  443-  '  Ibid.,  p.  440. 
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tkm  series  ninety- two  and  six- tenths  per  cent,  were  judged  to  be 
correct.  That  is  to  say,  there  was  a  greater  assurance  of  correctness 
when  the  learning  involved  recitation.  Moreover,  in  the  recitation 
tests,  of  those  written  down  ninety-three  and  four-tenths  per  cent. 
were  actually  correct  as  compared  to  sixty-nine  and  two-tenths  per 
cent,  for  the  reading  series,  indicating  again  that  there  is  less 
certainty  about  the  knowledge  of  results  during  reading.  It  should 
be  noted  that  in  the  reading  series  there  is  a  considerable  discrep- 

TABLE  XXXIX 
Results  g&en  in  number  of  syllables  correct  in  form  without  regard  to  position 


After  five  minutes  reading 

After  five  minutes  recitation 

Subject 

Number 
written 

Number 

judged 

correct 

Number 
actually 
correct 

Number 
written 

Number 

judged 

correct 

Number 
actually 
correct 

At. 

Rs. 

Py. 

Tr. 
Gl. 
Mn. 
An. 
E.  M. 
J.  M. 
Sn. 
Sa. 

Average 
P.  E. 

Per  cent,  of  number 

written 
Per  cent,  of  number 

judged  correct 

13 
8 

9 
7 
8 
11 
8 

5 
7 
7 
5 

8.0 
14 

13 
8 

7 

5 

4 
6 

4 

4 
6 

5 
4 

6.0 
1.5 

75.0 

II 
6 

7 
5 
5 
7 
5 
4 
4 
4 
3 

5-54 
1.3 

69.2 
923 

16 
16 
10 

15 
10 

12 

12 

10 

II 

16 

7 

12.2 
2.0 

15 
16 

9 

14 
10 

10 

11 

9 

9 
16 

6 

11. 3 
23 

92.6 

14.5 
16 

9-5 

14      ' 
10 

10 

II 

9 

10 

16 
6 

11. 4 
2.2 

934 
100. 0 

ancy  between  the  number  of  syllables  'judged  correct'  and  the 
number  'actually  correct';  while  for  the  recitation  method  these 
two  figures  are  almost  identical.  .This  means  that  after  you  have 
studied  a  lesson  by  the  recitation  method  you  are  practically  certain 
how  well  you  know  it,  but  after  you  have  studied  by  reading  you 
are  not  only  uncertain  about  your  knowledge  but  your  honest 
opinion  is  likely  to  be  an  overestimation  of  your  attainment.  A 
closer  examination  of  the  table,  however,  will  reveal  the  fact  that 
individuals  differ  in  this  respect.  Under  the  reading  method,  three 
people  correctly  estimate  their  knowledge  (i.  e.,  the  number  of 
syllables  'judged  correct'  equals  the  number  'actually  correct'); 
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of  a  mental  task  is  of  profound  importance  for  the  accomplishment 
of  the  task.  In  general,  it  may  be  said  that  an  emotion  of  pleasant- 
ness facilitates  the  function  of  memory,  and  that  unpleasantness 
has  a  very  detrimental  effect  upon  memory."  Thorndike  is  more 
cautious:1*  "No  one  probably  doubts  that  interest  in  the  exercise 
of  a  function  favors  improvement  at  it,"  and  "such  statements 
appeal  to  our  common  sense  as  probably  true,  though  they  have 
not  been  fully  verified." 

It  shall  be  our  purpose,  first,  to  inquire  as  to  what  differences 
appear  between  recitation  and  reading  as  producers  of  satisfying- 
ness  and  annoyingness,  and  then  to  consider  briefly  in  what  way  or 
by  means  of  what  minor  functions  these  effects  are  brought  about. 

That  there  is  greater  satisfyingness  in  studying  by  the  recitation 
method  is  indicated  by  the  witness  of  nearly  every  subject,  child  or 
adult.  At  the  close  of  the  experiments  with  the  school  children 
they  were  asked  to  state  what  method  of  learning  they  liked  best. 
For  ease  of  selection  the  cases  considered  were  three:  one  in  which 
they  read  all  the  time,  one  in  which  they  read  about  half  of  the 
time,  and  another  in  which  they  recited  nearly  all  the  time.  The 
following  table  gives  the  distribution  of  opinion. 


With  nonsense  material 


All  reading 

Half  and  half 

Mostly  recitation 

Grade  eight 
Grade  six 

3 

2 

2 
10 

29 
27 

Sense  material 

Grade  eight 
Grade  six 

4    ■ 

2 

17 
10 

20 
28 

It  is  clear  that  the  children  strongly  preferred  the  methods  in 
which  recitation  was  included. 

The  reasons  for  their  preferences  are  varied  and  not  very  specific. 
Such  statements  as,  "It  isn't  such  hard  work,"  "I  learn  better  that 
way/'  were  common.  Some  explained  their  preferences  as  follows: 
"I  knew  I  was  learning  them  when  I  recited";  "I  get  so  tired  when 
I  read";  "When  I  recite,  it's  fun  to  see  if  I  can  say  more  every  time 
than  I  ever  did  before." 

The  introspective  accounts  of  adults  are  even  more  emphatic. 
Among  the  subjects  listed  in  Table  XXXIII,  fourteen  reported  that 

*EdtumJiomol  Psychology,  rol.  II.  p.  210. 
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sented  in  Figures  7  and  8  by  P-Pl,  P-B1,  B-B}%  etc.)  are,  in  con- 
siderable degree,  already  given  in  the  material.  In  fact,  the  serial 
associations  between  the  words  of  familiar  phrases  are  already 
fixed  in  one's  nervous  system  through  earlier  practice.  Recitation, 
as  a  factor  making  possible  the  formation  of  many  connections,  is 
consequently  not  needed.  In  other  cases  where  the  connections 
are  less  definitely  formed,  only  a  small  amount  of  practice  is  re- 
quired to  stamp  them  in.  The  result  is  that  in  so  far  as  the  con- 
nections are  ready-formed,  reading  amounts  in  all  essentials  to 
recitation.  The  eye  neglects  many  of  the  words  as  such,  fixating 
only  occasional  points.  Reading  thus  becomes  far  from  pure  and 
approaches  recitation,  in  all  likelihood,  more  and  more  closely  as 
the  learning  advances. 
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INTRODUCTION 

A  SURVEY  OF  THE  SUBJECT  OF  MENTAL  FATIGUE 
DURING  CONTINUOUS  EXERCISE  OF  A  SINGLE  FUNCTION 

So  far  the  investigations  of  various  experimenters  in  the  field  of 
Mental  Fatigue  during  continuous  exercise  show  that  continuous 
work  under  the  lash  of  keen  motivation  reduces  the  efficiency  only 
slightly,  even  though  the  subjects  worked  from  one  to  two  hours. 
Burgerstein,  'pi,  found  in  an  experiment  with  a  large  group  of  boys, 
aged  eleven  to  thirteen  years,  in  which  the  pupils  performed  easy 
examples  in  addition  and  multiplication  in  ten-minute  periods  with 
five-minute  rests  between,  that  the  number  of  examples  increased 
as  the  test  proceeded,  but  there  were  more  errors  and  corrections 
made  by  the  pupils  as  the  work  went  on. 

Hdpner,  '94,  undertaking  to  make  the  exercise  more  like  that  of 
the  ordinary  recitation,  had  a  class  of  forty-six  boys,  of  average  age, 
nine  years,  write  nineteen  sentences  from  dictation.  Each  sentence 
was  read  aloud  to  the  class  once,  then  it  was  repeated  once  by  a 
single  pupil,  next  by  the  entire  class,  and  then  the  pupils  were  re- 
quired to  write  it  from  memory.  The  experiment  extended  over 
two  hours.  Hdpner  found  that  as  the  time  proceeded,  the  pupils 
became  less  exact.  Colloquial  speech  often  took  the  place  of  the 
words  in  the  dictated  sentence.  It  is  very  evident  that  the  materials 
for  the  experiment  were  not  of  equal  difficulty.  Neither  were  the 
pupils  pressed  to  their  utmost.    (Offner  &  Whipple,  Mental  Fatigue, 

57«) 

Holmes,  'qj,  had  children  from  Grades  Three  to  Eight  add  num- 
bers for  thirty-six  minutes  and  broke  the  time  into  four  periods  of 
nine  minutes  each.  There  was  an  increase  in  errors  of  adding  and 
copying.  But  when  everything  in  the  way  of  length  of  problem 
and  speed  is  taken  into  consideration,  the  decrease  in  efficiency  is 
not  very  great. 

Cattell  and  Dolley  found  that  simple  reaction-time  is  not  influ- 
enced by  previous  reactions  to  any  great  extent. 


INTRODUCTION  IX 

F.  M.  Phillips,  Journal  of  Educational  Psychology,  191 6,  had 
pupils  of  school  grades  of  Fourth  to  Eighth  work  for  ten  minutes 
on  arithmetic  problems  of  addition,  subtraction,  multiplication  and 
division.  At  the  end  of  each  minute  the  subject  made  a  mark  on 
the  paper  so  that  the  experimenter  knew  what  was  done  each 
minute  by  the  subjects.  In  all  the  processes  the  best  work  was 
accomplished  during  the  first  minute.  But  the  experimenter  did 
not  undertake  to  show  whether  there  was  fatigue  or  not.  He 
found  correlations  between  the  first  and  last  periods,  in  all  the 
processes,  ranging  from  .54  to  .73,  and  says  that  the  work  of  the 
first  minute  is  less  variable  than  that  of  later  minutes,  and  that  it 
is  a  fair  index  in  all  probability  of  one's  ability  in  arithmetic. 

W.  S.  Painter,  Journal  of  Educational  Psychology,  19 16,  did  mental 
multiplication  of  four-place  numbers  after  much  mental  and  physi- 
cal work  which  had  resulted  in  a  feeling  of  fatigue.  He  worked 
from  1 1  p.  m.  until  3 :07  a.  m.  During  the  latter  part  of  the  experi- 
ment there  was  aa  marked  rise  in  time"  per  problem  and  the  experi- 
menter thinks  that  "the  outcome  suggests  strongly  that  there 
exists  a  definite  and  relatively  abruptly  appearing  point  beyond 
which  mental  work  becomes  impossible."  While  the  time  in  per- 
forming the  last  three  multiplications  is  high,  the  errors  are  rela- 
tively few.  Mr.  Painter  believes,  however,  that  after  this  abrupt 
point  all  mental  work,  properly  so  called,  was  practically  impossible. 


CHAPTER  I 
THE  ADMINISTRATION  OF  THE  EXPERIMENT 

The  Subjects  of  the  Experiment 

There  were  seven  hundred  and  eleven  subjects  in  these  experi- 
ments. Three  hundred  and  sixty-eight  of  them  were  children  in 
the  Third  and  Fourth  grades,  and  three  hundred  and  forty-three 
of  them  were  children  of  the  Seventh  and  Eighth  grades  of  the 
public  schools  of  Virginia,  all  white  children.  A  large  part  of  the 
number  was  from  the  city  schools  of  Richmond  and  Petersburg. 
The  smaller  part  was  from  the  Training  School  of  the  State  Normal 
School  at  Farmville,  Va.t  and  the  public  schools  of  Farmville,  Va. 
The  boys  and  girls  were  about  equally  divided  and  their  ages  were  * 
those  of  the  average  for  the  grades  in  which  the  tests  were  given. 
There  was  absolutely  no  selecting  of  subjects,  but  the  experimenter 
took  the  cases  where  he  could  get  them.  For  this  reason  it  may  be 
taken  as  a  fact  that  the  results  represent  the  work  of  the  average 
child  of  these  grades. 


Materials  Used 

The  materials  used  were  the  Thorndike  addition  sheets,  such  as 
those  used  by  Kirby  in  the  experiment  described  in  his  "Practice 
in  the  Case  of  School  Children,"  Teachers  College,  Columbia  Uni- 
versity Contributions  to  Education,  No.  53.  There  are  seven  differ- 
ent sheets.  Each  has  forty-eight  columns  of  one-place  numbers, 
each  column  contains  ten  addends  with  the  ifs  and  the  o's  omitted, 
and  each  column  is  so  arranged  that  any  successive  five  of  the 
columns  are  of  a  difficulty  nearly,  if  not  exactly,  equal.  These 
sheets  were  arranged  in  pads.  For  the  Third  and  Fourth  grades 
there  were  fourteen  sheets,  and  for  the  Seventh  and  Eighth  grade 
group  there  were  twenty-one  sheets  in  a  pad.  There  was  no  possi- 
bility of  a  child's  remembering  the  answers  on  a  sheet  which  re- 
curred, because  there  would  be  no  way  of  identifying  that  sheet. 
Eye  strain  was  reduced  to  a  minimum  because  the  type  is  so  very 
large,  and  besides,  the  eyes  got  a  rest  every  two  minutes. 
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Method  of  Scoring 

With  fourteen  sheets  to  every  one  of  the  368  Third  and  Fourth 
grade  pupils  and  21  sheets  to  every  343  Seventh  and  Eighth  grade 
pupils,  the  experimenter  secured  12,355  papers.  For  the  Third  and 
Fourth  grades  there  were  fourteen  periods  of  two  minutes  each  and 
for  the  older  group  there  were  twenty-one  periods  of  two  minutes 
each.  When  these  papers  were  examined,  a  record  was  made  of 
what  each  child  attempted  each  two  minutes,  and  another  record 
of  the  accuracy  of  each  child  for  every  two-minute  period.  If  a 
child  attempted  six  columns,  he  received  a  credit  for  that  two  min- 
utes of  six  columns  attempted.  If  only  four  of  these  were  correct, 
he  received  credit  on  the  accurate  record  sheet  of  only  four  columns. 
These  two  records,  one  of  attempts  and  one  of  accurates,  gave  two 
tables,  in  the  one  case  having  fourteen  columns  368  figures  long,  and 
in  the  other  having  twenty-one  columns  343  figures  long  for  at- 
tempts, and  likewise  the  same  for  accurates.  In  short,  we  should 
say  that  the  two  groups  of  children — Third  and  Fourth  grades  and 
Seventh  and  Eighth  grades — had  two  arrays  of  results,  one  for 
attempts  and  one  for  accurates. 

If  a  child's  record  showed  itself  incomplete — nothing  attempted 
after  a  certain  time — except  in  the  last  period  or  so,  his  work  was 
not  counted  in  the  experiment.  One  child  had  to  stop  because  of  a 
slight  illness  which  she  had  when  she  came  to  school  that  morning. 
Another  boy  was  convalescent  from  typhoid  fever  and  had  to  stop 
in  the  midst  of  the  experiment.  If  a  lack-a-daisical  attitude  toward 
the  experiment  was  evidenced  by  any  great  omission  of  effort 
in  the  written  record,  the  material  was  thrown  out.  But  it  so  hap- 
pened that  there  was  very  little  that  had  to  be  discarded.  A  child 
was  given  credit  for  what  he  did,  both  in  quantity  and  quality. 

Time  of  Day  and  Year 

According  to  Heck's1  experiments,  the  time  of  day  makes  little 
difference  and  so  the  experimenter  made  his  tests  at  any  time  dur- 
ing the  school  day — early  morning  period,  noon,  and  afternoon 
indiscriminately.  Since  there  was  a  generous  sampling  of  all  times 
of  the  day,  no  one  time  of  the  day  with  its  fatigue  could  assert  itself 

1 W.  H,  Heck,  A  Study  of  Mental  Fatigue,  1913. 
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to  any  great  extent.    The  test  was  intended  to  show  what  happens 
during  a  recitation  at  any  time  of  the  day. 

The  time  of  the  year  was  in  the  fall,  in  the  winter,  and  in  the 
spring.  One  class  took  its  test  when  the  snow  was  falling  on  the 
ground,  a  large  part  of  the  groups  took  their  tests  in  November, 
and  some  of  the  classes  worked  with  the  windows  open  to  the  spring 
breeze.  The  tests  were  given  during  the  time  elapsing  between 
December,  1913,  and  November,  1914. 


CHAPTER  II 
ATTEMPTED  AND  ACCURATE  PERFORMANCE 


The  Group  Curves 

Four  curves  are  given  herewith,  plotted  from  the  tables  which 
accompany  them.  There  are  two  work  or  attempts  curves,  one  for 
Third  and  Fourth  grades  and  one  for  Seventh  and  Eighth  grades; 
and  there  are  two  accurates  curves,  respectively,  for  Third  and 
Fourth  grades  and  for  Seventh  and  Eighth  grades.  In  the  Third 
and  Fourth  grade  group  there  were  368  children  participating  and 
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in  the  Seventh  and  Eighth  grade  group  there  were  343  who  took 
part.  The  Third  and  Fourth  grade  group  worked  for  twenty-eight 
minutes  actually.  This  time  was  divided  into  fourteen  periods  of 
two  minutes  each.  The  horizontal  line  represents  the  time,  in 
periods,  during  which  the  groups  worked.  The  vertical  line  indi- 
cates the  number  of  columns  either  attempted  or  accurately  done. 
In  the  case  of  the  work  curve  this  vertical  line  indicates  columns 
attempted  whether  right  or  wrong;  in  the  case  of  the  accuracy  curve 
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the  vertical  scale  stands  for  columns  correctly  added.  Every  point 
on  the  curve  was  ascertained  by  finding  the  average  attained  by 
the  group  for  that  identical  two-minute  period  of  work.  We  shall 
call  these  the  group  curves. 

These  curves  are  given  here  for  the  sake  of  presenting  the  facts 
derived  by  the  experiment.  These  are  mere  gross  results.  The 
attempts  and  accuracy  curves  derived  herewith  do  not  afford  a 
true  idea  of  measurement  of  fatigue  of  the  individuals  during  the 
work  period  of  twenty-eight  minutes  for  the  Third  and  Fourth 
grade  group  nor  for  the  forty-two  minutes  during  which  the  Seventh 
and  Eighth  grade  group  worked.    If  instead  of  giving  the  average 
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we  gave  the  quantity  obtained  by  the  group,  this  would  emphasize 
the  production  by  the  group  as  a  whole.  These  first  curves  give 
the  changes  in  the  group  without  regard  to  the  changes  of  the 
individual.  The  curves  following  these  will  give  the  average  of 
the  individual  curves  and  thus  will  regard  individual  changes. 

TABLE  I 

Attempts  of  Third  and  Fourth  Grades — Absolute  Measures 

Columns  attempted  for  each  period  of  two  minutes 


triad 

Average 

A.D. 

P.E. 

I 

315 

1.20 

.058 

2 

3 

35 

1. 17 

.051 

3 

3 

47 

1.22 

•053 

4 

3 

48 

1-34 

059 

5 

3 

*7 

1. 17 

.051 

6 

3 

37 

1-25 

055 

7 

3 

45 

1-34 

059 

8 

3 

54 

1.33 

.058 

9 

3 

55 

1.38 

.061 

10 

3 

57 

1.39 

.061 

11 

3 

49 

1. 31 

057 

12 

3 

28 

1.31 

057 

13 

3 

51 

1. 41 

.062 

• 

14 

3 

38 

I.36 

.060 

TABLE  II 
Accurates  of  Third  and  Fourth  Grades — Absolute  Measures 

Columns  accurate  for  each  period  of  two  minutes 


mod 

Average 

A.D. 

P.E. 

1 

1.70 

1.27 

.056 

2 

1-93 

1.1 

.048 

3 

2. 11 

1.32 

.058 

4 

2.06 

1.28 

.056 

5 

1.88 

1. 16 

.051 

6 

2.07 

1.24 

054 

7 

1.86 

1. 21 

053 

8 

I  99 

1. 16 

.051 

9 

1.98 

1-34 

059 

10 

1.96 

130 

057 

11 

1.94 

1.27 

.056 

12 

1-79 

1.30 

057 

13 

1.82 

1. 21 

053 

14 

1.78 

130 

057 
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TABLE  III 

empts  of  Seventh  and  Eighth  Grades- 

-Absolute  Idea, 

Columns  attempted  for  each  period 

of  two  minutes 

Period 

Average               A, 

.D. 

P.E. 

i 

6.02                           I 

67 

075 

2 

562                   1 

39 

.062 

3 

577                   1 

5 

.068 

4 

5 -92                   1 

61 

.072 

5 

546                   1 

51 

.068 

6 

578                   1 

55 

07 

7 

564                   1 

53 

.069 

8 

581                   1 

69 

.076 

9 

568                   1 

77 

.079 

10 

598                   1 

52 

.068 

ii 

594                   1 

56 

07 

ia 

565                   1. 

69 

.076 

13 

5  99                   1 

5 

.068 

H 

583                   1 

68 

.076 

15 

6.23                   1. 

95 

.088 

16 

5-91                    1 

52 

.068 

17 

6. 11                     I. 

67 

075 

18 

595                    1 

84 

083 

19 

561                     I. 

7 

077 

20 

6.02                     I. 

78 

.08 

21 

599                    I 

9i 

.086 

TABLE  IV 
Accurates  of  Seventh  and  Eighth  Grades — Absolute  Measures 

Columns  accurate  for  each  period  of  two  minutes 


Period 

Average 

A.D. 

P.E. 

1 

4.22 

1.85 

.083 

2 

404 

1.63 

.074 

3 

4.19 

1.50 

.068 

4 

4  30 

183 

.082 

5 

4.01 

1-57 

.061 

6 

4.18 

1.94 

.087 

7 

403 

1-59 

.072 

8 

4.22 

1.64 

.074 

9 

4.64 

1.65 

073 
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TABLE  IV  (Continues) 
Accurate*  of  Seventh  and  Eighth  Grades — Absolute  Measures 

Columns  accurate  for  each  period  of  two  minutes 


eriod 

Average 

A.D. 

P.  E. 

IO 

4  3i 

1.68 

075 

II 

4.29 

1. 71 

.076 

12 

3  89 

1.76 

.079 

13 

4.19 

1-74 

.078 

14 

388 

1.76 

.079 

15 

424 

1. 91 

.085 

16 

403 

1. 71 

.077 

17 

4.26 

1.72 

.077 

18 

4.02 

1.72 

.077 

19 

388 

1.77 

.080 

20 

3  93 

1.83 

.082 

21 

3  74 

1.82 

.081 

Average  of  the  Individual  Curves 

The  object  in  a  study  of  this  kind  is  to  give  every  individual, 
whether  his  work  is  slow  or  fast,  the  same  influence  upon  the  final 
average.  It  is  not  fair  to  the  poor  or  weak  individual  to  put  his 
small  effort  on  a  basis  of  absolute  terms  along  with  the  effort  of  the 
better  workers  similarly  expressed.  The  former  may  fatigue  while 
the  latter  gain  and  a  mean  between  them  show  essentially  the  curve 
of  the  better  worker.  The  original  data  of  the  preceding  tables  fail 
to  represent  truly  the  facts  which  we  wish  to  bring  out  because,  as 
intimated  above,  the  rapid  workers  with  their  larger  measures  of 
performance  entirely  swamp  the  changes  that  may  occur  in  the 
work  of  the  slower  ones.  But  if  everyone's  work  for  the  successive 
periods  is  reduced  to  percentages  of  his  total,  the  slow  count  the 
same  as  do  the  fast  workers  in  determining  the  general  work  curve. 
For  this  reason  we  have  derived  percentage  curves  which  represent 
more  truly  than  the  foregoing  curves  the  central  tendency  of  the 
whole  group  with  regard  to  fatigue.  With  the  absolute  numbers 
we  can  examine  the  question  of  fatigue  from  the  standpoint  of  one 
interested  in  the  total  product  of  a  group,  whereas  by  the  personal 
curves  we  disregard  the  total  products  and  examine  changes  in  the 
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working  ability  of  the  individuals,  and  the  general  tendency  of 
these  individual  changes. 
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The  curves  shown  herewith  (Figures  3  and  4)  are,  however,  only 
slightly  different  in  form  from  the  preceding  curves.  Every  number 
in  the  distribution  is  a  percentage  of  the  total  accomplished  during 
the  entire  period  of  work  for  each  installment  of  time  for  each  child. 
A  child  did  so  much  every  two  minutes  for  twenty-eight  and  forty- 
two  minutes  in  the  Third  and  Fourth  grade  group  and  the  Seventh 
and  Eighth  grade  group  respectively.     Percentages  of  these  dis- 
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tributions  were  determined  by  dividing  each  two  minutes'  work  by 
the  total  amount  added  during  the  whole  period  of  work  by  each 
individual.  This  gave  fourteen  per  cents,  in  the  younger  group  for 
each  child,  and  twenty-one  per  cents,  in  the  Seventh  and  Eighth 
grade  group  for  each  child  of  that  group.  The  fourteen  average 
per  cents,  for  the  Third  and  Fourth  grade  group  were  obtained, 


4- 


<s 


1 


o    i 


erttffA  tUfd&ttft    (r>*<Scs. 


KfM 


V  /L  <?/*// *v +-/ 


1      J*j,r ;</**/  Cvrvti. 


and  the  twenty-one  average  per  cents,  for  the  Seventh  and  Eighth 
grade  group  likewise  were  obtained,  and  these  averages  give  the 
accompanying  curves.  Every  position  on  the  curves  indicates  the 
central  tendency  of  the  relative  value  in  attempts  and  accuracy  of 
the  groups  for  any  two  minutes  of  the  time  of  working;  and  this 
should  be  taken  as  meaning  the  comparative  working  ability  at  that 
period.  The  attempts  curve  does  not  signify  a  pure  mental  per- 
formance, while  the  accurates  curve  here  expressed  in  percentages 
does  represent  a  more  nearly  pure  mental  process. 
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TABLE  V 

Dftafor  the  Curves  Representing  the  Average  of  the  Individual 

Curves — Third  and  Fourth  Grades 

Columns  attempted  in  each  period  of  two  minutes,  expressed 
as  a  per  cent,  of  the  total  number  attempted 


mod 

Range 

Average            A 

.D. 

P.E 

Per  Cent. 

Per  Cent. 

I 

0-50 

6.97                1 

94 

.09 

2 

0-25 

724                1 

52 

.08 

3 

0-17 

730                1 

37 

.06 

4 

0-17 

724                1 

40 

.06 

5 

0-25 

6.97                1 

32 

.06 

6 

0-14 

7.20                1 

32 

.06 

7 

0-18 

6.97                1 

35 

.06 

8 

0-25 

7.29                1 

43 

.06 

9 

0-17 

734                1 

39 

.06 

10 

0-12 

7.28                1 

44 

.06 

ii 

0-14 

727                1 

34 

.06 

12 

0-13 

6.78                1 

47 

07 

13 

0-13 

725                1. 

31 

•05 

14 

0-16 

6.90                1 
100.00 

62 

.07 

TABLE  VI 
Data  for  the  Curves  Representing  the  Average  of  the  Individual 

Curves — Third  and  Fourth  Grades 

Columns  accurate  for  each  period  of  two  minutes, 
in  per  cent,  of  total  columns  accurate 


mod 

Range 

Average 

A. 

D.             P 

.E 

Per  Cent. 

PerCent. 

1 

0-100 

6.13 

453 

20 

2 

0-100 

8-34 

4 

87 

22 

3 

0-50 

8.16 

4 

34 

.21 

4 

o-34 

753 

4 

03 

13 

5 

0-100 

7  27 

4 

20 

19 

6 

0-50 

776 

4 

10 

.18 

7 

0-100 

6.94 

4 

01 

18 

8 

0-28 

7.24 

4 

05 

18 

9 

0-100 

7.62 

4 

57 

.21 

10 

0-50 

7.16 

4 

3i 

19 

11 

0-29 

7.06 

4 

27 

19 

12 

0-30 

6.10 

4 

07 

.18 

13 

0-34 

6.89 

4 

30 

19 

14 

0-40 

5-8o 
100.00 

3 

75 

17 
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TABLE  VII 

Data  for  the  Curve  Representing  the  Average  of  the  Individual 
Curves — Seventh  and  Eighth  Grades 

Columns  attempted  for  each  period  of  two  minutes, 
in  per  cent,  of  total  columns  attempted 


riod 

Range 

Average 

A.  D.             P.  E 

Per  Cent. 

Per  Cent. 

1 

2-10 

500 

1. 01 

05 

2 

0-10 

4- 

86 

79 

04 

3 

0-9 

4- 

67 

77 

04 

4 

2-10 

4- 

79 

.69 

03 

5 

2-S 

4 

37 

75 

03 

6 

3-« 

4 

73 

.72 

03 

7 

2-8 

5 

30 

1.04 

05 

8 

1-11 

4 

63 

79 

04 

9 

2-9 

4 

59     , 

75 

03 

10 

3-« 

4 

86 

75 

03 

11 

1-8 

4 

80 

.68 

03 

12 

2-10 

4 

43 

74 

03 

13 

1-16 

4 

4* 

.88 

04 

14 

2-7 

4 

68 

.83 

04 

15 

1-9 

5 

5« 

1. 11 

05 

16 

1-9 

4 

74 

.62 

03 

17 

0-9 

4 

.80 

•71 

03 

18 

0-9 

4 

■75 

.90 

04 

19 

0-8 

4 

40 

.86 

.04 

20 

0-9 

4 

.84 

.91 

04 

21 

O-II 

4 

76 

.90 

.04 

100 

.00 

TABLE  VIII 
Data  for  the  Curve  Representing  the  Average  of  the  Individual 
Curves — Seventh  and  Eighth  Grades 

Columns  accurate  for  each  period  of  two  minutes, 
in  per  cent,  of  total  columns  accurate 

P.E. 


.08 
.07 

.07 
.06 
.06 
.06 
.07 
.06 


riod 

Range 

Average 

A.D. 

Per  Cent. 

Per  Cent. 

I 

0-20 

500 

174 

2 

0-14 

4  85 

1.51 

3 

0-30 

485 

1. 51 

4 

0-27 

5  01 

1.37 

5 

O-II 

4  SO 

1  37 

6 

0-15 

5  03 

1  33 

7 

0-20 

4  70 

1.46 

8 

0-12 

4- *3 

1.37 
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I.  Maximum  period 
II.  Minimum  period 

III.  Average  first  three  periods 

IV.  Average  last  three  periods 
V.  Per  cent,  loss  or  gain 

III  and  IV 
VI.  Average  part  one  (or 
first  third  of  curve) 
VII.  Average  part  two  (or 
second  third  of  curve) 
VIII.  Average  part  three  (or 
third  third  of  curve) 
IX.  VI  as  base 
VII  :  VI 
VIII  :  VI 


TABLE  IX 
Absolute  Measures 


Third  and  Fourth 

Grades 

Attempts     Accuracy 

Third 
First 
1. 9 1  cols. 
1.79  cols. 
6.2  loss 


Tenth 
First 
3.32  cols. 
3.39  cols. 
2.0  gain 


Seventh  and  Eighth 

Grades 
Attempts     Accuracy 

Fifteenth  Ninth 

Fifth  Second 

5.80  cols.  4.15  cols. 

5.87  cols.  3.85  cols. 

1. o  gain  7.0  loss 


3.36  cols.     1.95  cols.     5.74  cols.    4.14  cols. 

3.44  cols.     1.96  cols.    5.84  cols.    4.20  cols. 

3.45  cols.     1.86  cols.    5.97  cols.    4.01  cols. 


I. CO 

1. 00 

1. 00 

1. 00 

1.023 

1.005 

1. 01 7 

1. 014 

1.026 

.95 

1.04 

•97 

TABLE  X 

From  the  Data  of  the  Curves  Representing  the  Average 

of  the  Individual  Curves 


I.  Maximum  period 
II.  Minimum  period 

III.  Average  first  three  periods 

IV.  Average  last  three  periods 
V.  Per  cent,  loss  or  gain 

VI.  Average  part  one  (or 
first  third  of  curve) 
VII.  Average  part  two  (or 

second  third  of  curve) 
VIII.  Average  part  three  (or 
third  third  of  curve) 

IX.  VI  as  base 

VII  :  VI 

VIII  :  VI 


Third  and  Fourth 

Seventh  and  Eighth 

Grades 

Grades 

Attempts 

Accuracy 

Attempts 

Accuracy 

Ninth 

Second 

Fifteenth 

Tenth 

Twelfth 

Four- 

Fifth 

Twenty- 

teenth 

first 

7.17% 

7-54% 

485% 

4-90% 

6.98% 

6.26% 

467% 

4.40% 

3.0  loss 

17.0  loss 

4.0  loss 

10.2  loss 

7.19% 

7.54% 

4.82% 

4.85% 

7.15%         7.37%         4-63%         4-79% 
7.10%         6.60%         484%         4-63% 


1 .00 

1. 00 

1. 00 

1. 00 

.99 

.98 

.96 

•99 

.98 

.88 

1.004 

•95 
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occurred  in  the  third  period  or  at  about  the  sixth  minute.  As  to 
the  minima,  they  occur  before  the  maxima  and  indicate  lack  of 
adaptation  in  consequence.  The  foregoing  facts  indicate  that  the 
maximum  was  reached  earlier  by  fourteen  minutes  in  the  accurates 
curve  than  in  the  attempts  curve.  For  the  similar  curves  of  the 
Seventh  and  Eighth  grade  group  the  same  observation  is  made  that 
the  maximum  of  accurates  preceded  that  of  attempts  by  ten  min- 
utes. The  older  group  showed  more  persistence,  as  the  maximum 
of  accurates  occurred  in  the  ninth  period  or  about  the  eighteenth 
minute  and  that  of  attempts  in  the  fifteenth  period,  or  between 
the  twenty-eighth  and  thirtieth  minutes.  Oehrn  found  that  when 
his  adult  subjects  added  continuously  for  two  hours,  they  attained 
their  maximal  speed  about  twenty-eight  minutes  from  the  start. 
(Whipple,  Manual  of  Menial  and  Physical  Tests,  335.) 

From  the  curves  representing  the  average  of  the  individual 
curves  the  same  thing  is  true  as  to  the  maximal  attainment  of 
accuracy  occurring  before  that  of  work  in  attempts.  The  minima 
of  accuracy  siftce  they  are  found  following  the  maximal  points  in 
both  groups  register  fatigue.  (See  Table  X  for  the  data  from  which 
these  observations  are  made.) 

The  two  standpoints — interest  in  total  work  and  in  changes  in 
working  ability — make  practically  no  difference  as  to  the  time  of 
occurrence  of  the  maxima. 

The  general  conclusions  to  be  drawn  here  are  then: 

1.  Fatigue  is  made  evident  in  a  curve  of  this  sort  by  the  line  falling  away 
from  the  maximum. 

2.  Workers  attain  their  maximum  of  accuracy  before  they  attain  that 
point  in  attempting. 

3.  In  both  quantity  and  quality  of  work,  the  younger  children  reach 
their  maximum  as  a  group  before  the  older  ones,  and  therefore  notably 
fatigue  sooner. 

4.  The  occurrence  of  the  minimum  after  the  maximum  is  in  consequence 
of  fatigue  and  not  from  lack  of  adaptation. 

Fatigue 

If  we  wish  to  find  fatigue  in  an  attempt  or  accurate  performance 
curve  we  look  for  it  certainly  at  the  end  of  the  performance  because, 
though  it  may  have  been  a  factor  nearly  all  along  the  way,  it  would 
here  be  more  in  evidence  than  elsewhere.    Fatigue  is  made  evident 
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of  four  minutes  each.  Some  of  the  chance  irregularities  of  the  origi- 
nal curves  being  thus  removed,  the  general  course  of  the  curves  can 
be  better  seen.      -*.  v 

From  Figures  i-a  and  2-a  it  appears  that  the  working  power  of  the 
group  as  a  whole  remained  very  nearly  constant  during  the  experi- 
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Fig .  i-a.   Third  and  Fourth  Grades 
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Fig.  2-a.  Seventh  and  Eighth  Grades 
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ment,  though  there  is  a  slight  but  definite  descent  in  the  curves  for 
accurate  work,  and  this  decline  begins  earlier  in  the  younger  than 
in  the  older  group. 

8  r 


5     - 


§ 

U 


4 


3    - 


ftH;*n%fAs 


fjccut*  +es 


'tit —         ■     *     f    i 


Periods  2  46  8  10  12  14 

Fig.  j-a.    Third  and  Fourth  Grades 

We  next  divide  the  curves  into  three  parts,  as  nearly  as  possible 
thirds  in  the  Third  and  Fourth  group,  and  exact  thirds  in  the 
Seventh  and  Eighth  grade  group.  The  former  group  is  divided 
thus — four  periods  in  the  first  part  and  five  periods  in  the  second 
and  third  parts.  The  fact  that  there  were  fourteen  periods  makes 
this  unequal  division  necessary.  The  Seventh  and  Eighth  grade 
group  curve  is  divided  into  three  parts,  each  containing  seven 


ATTEMPTED  AND  ACCURATE  PERFORMANCE        21 

periods.  In  the  accompanying  table,  No.  IX,  for  Group  Curves, 
if  the  reader  will  refer  to  VI,  VII,  and  VIII,  he  will  find  the  averages 
and  ratios  to  which  we  are  going  to  refer.  In  the  case  of  the  Third 
and  Fourth  grade  group  the  average  amount  attempted  each  two 
minutes  for  this  part  of  the  curve  (eight  minutes)  was  3.36  columns, 
for  the  second  part  or  ten  minutes  following  the  first  division  of 
time,  the  average  was  3.44  columns  and  for  the  last  ten  minutes  of 

6  r- 


e 

83 


%m 


1     1 


Periods         2  4  6  8  10         12         14         ib         16         20         *i 

Fig.  4~a.  Seventh  and  Eighth  Grades 

work  345  columns  were  attempted  for  two  minutes  on  the  average. 
This  shows  a  steady  rise,  in  the  ratios  of  1.00,  1.023,  and  1*026. 

In  the  case  of  the  Seventh  and  Eighth  grade  group  the  three 
equal  parts  of  the  whole  forty-two  minutes  show  thus  an  average 
for  the  first  fourteen  minutes  of  5.74  columns  attempted,  for  the 
second  fourteen  minutes  5.84  columns  were  attempted  and  for  the 
last  fourteen  minutes  of  time  an  average  of  5.97  columns  were  at- 
tempted for  two  minutes.  This  likewise  shows  a  rise.  The  ratios 
are  1 .00,  1.017,  and  1.04.  These  rises  are  so  slight  that  too  much 
significance  should  not  be  given  them. 

In  the  case  of  accurates,  the  first  eight  minutes  in  the  Third 

and  Fourth  grade  groups  shows  an  average  of  1.95  columns  correctly 

solved  for  each  two  minutes.    The  next  ten  minutes  of  the  total 

time  produced  an  average  of  1.96  columns  correctly  solved  for  each 
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'Warming-up1  and  'Initial-Spurt 

We  now  proceed  to  examine  these  curves  to  see  if  there  is  'Warm- 
ing-up9 or  'Initial-spurt'.  The  best  definition  of  'Warming-up'  as 
an  objective  act  is  that  part  of  an  increase  of  efficiency  during  the 
first  twenty  minutes  (or  some  other  assigned  early  portion)  of  a 
work  period,  which  is  abolished  by  a  moderate  rest,  say  of  sixty 
minutes."  Thorndike,  Educational  Psychology,  vol.  Ill,  p.  66. 
"'Initial-spurt',  if  a  real  fact,  will  be  found  in  an  examination  of 
the  work,  minute  by  minute,  of  the  first  quarter  of  an  hour."  Ibid., 
p.  48.    A  sudden  rise  at  the  start  will  indicate  'Initial-spurt'. 

The  graphic  representation  of  the  attempted  and  accurate  work 
affords  perhaps  the  best  objective  material  for  determining  the 
presence  or  absence  of  these  phenomena  in  the  performance  under 
discussion,  and  so  we  call  attention  to  the  curves  given  in  Figures 
1  and  2,  and  derived  from  Tables  I,  II,  III,  and  IV  for  Absolute 
Measures,  and  Figures  3  and  4  derived  from  Tables  V,  VI,  VII, 
and  VIII.  The  curves  for  the  younger  group  show  a  fairly  steady 
rise  in  the  first  six  minutes  in  both  attempts  and  accurate  perfor- 
mances in  all  the  curves  representing  them,  and  from  this  evidence 
we  may  say  there  was  'Warming-up'  for  them.  If  it  should  be 
objected  that  these  rises  were  merely  incidental  and  due  to  chance, 
we  may  resort  to  the  tables  showing  the  averages  and  their  probable 
errors.  By  taking  the  difference  between  the  averages  of  the  suc- 
cessive periods,  first  and  second,  second  and  third,  and  bringing 
these  into  relation  to  the  square  root  of  the  sum  of  their  respective 
squared  P.  E.'s,  we  may  determine  the  reliability  of  these  differences. 
We  give  here  these  reliabilities.  The  chances  that  the  gain  of  period 
two  over  period  one,  in  Table  I,  is  reliable  are  91  out  of  100;  for  peri- 
od three  over  period  two  they  are  75  out  of  100.  This  'Warming-up' 
holds  there  for  attempts  in  the  Third  and  Fourth  grades.  As  to 
aocurates  the  case  is  even  better,  for  the  chances  that  the  gain  of 
period  two  over  period  one,  in  Table  II,  is  reliable  are  96  out  of  100, 
and  of  the  gain  of  period  three  over  period  two  are  92  out  of 
100,  in  the  Third  and  Fourth  grades.  This  holds  for  the  Absolute 
Measures. 

In  the  case  of  the  curves  representing  the  Average  of  the  Indi- 
vidual Curves,  we  have  the  following  facts  as  to  'Warming-up'. 
The  chances  that  the  gain  of  period  two  over  period  one  is  a  true 
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rise  in  efficiency,  due  to  a  knowledge  on  the  part  of  the  subjects  of 
the  approaching  end  of  the  task. 

The  experimenter  here  did  all  in  his  power  to  conceal  the  ap- 
proaching end  of  the  test.  For  this  reason  we  do  not  think  these 
data  should  be  examined  with  the  end  in  view  of  finding  'End-spurt'. 

The  writer  has  a  conviction  that  interference  operated  at  the  be- 
ginning of  the  test  because  of  the  strong  motivation.  The  desire 
to  excel  must  have  acted  as  a  hindrance  at  this  part  of  the  game  in- 
asmuch as  it  probably  acted  as  a  distraction  from  letting  the  nec- 
essary associations  play  freely.  Consequently,  it  would  lower  the 
score  especially  of  accuracy.  It  also  probably  played  strongly 
toward  the  end  of  the  test  and  may  account  for  some  of  the  fatigue. 
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workers  as  well  as  among  the  better  workers  as  determined  by  total 
performances. 


TABLE  XI 

Showing  Changes  in  Working  Ability — Third  and  Fourth  Grades 

Per  Cent,  of  Columns  Attempted 

Case  22         Case  138         Case  276         Case  344         Case  367 
Period         Per  Cent.        Per  Cent.        Per  Cent.        Per  Cent.        Per  Cent. 

1  14  5  5  8  1 

2  14  8  5  6  5 

3  5  10  5  8  8 


33  23  15  22  14 


4 

0 

8 

5 

7 

8 

5 

14 

7 

7 

7 

8 

6 

9 

10 

7 

6 

8 

7 

5 

5 

5 

8 

8 

61  53  39  50  46 


8  6  7  9 

9  5  8  8 

10  5  5  8 

11  5  8  10 

12  5  5  10 

13  5  7  8 

14  9  7  8 

100     19  100     19  100    26 


8 

8 

6 

8 

8 

8 

8 

2 

8 

8 

6 

8 

6 

8 

100    20 

100 

Average 
percent.  7.1  7.1  7.1  7.1  7-* 

Total  columns 
attempted  21  40  60  79  191 
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TABLE  XI  (Continued) 
Third  and  Fourth  Grades — Per  Cent,  of  Total  Accurate  Columns 


Case  142 

Case  246 

Case  329 

Case  350 

Case  368 

Hod 

Per  Cent. 

Per  Cent. 

Per  Cent. 

Per  Cent. 

Per  Cent. 

I 

26 

15 

8 

7 

4 

2 

16 

15 

8 

7 

7 

3 

11 

9 

6 

9 

7 

53  39  22  23  18 


4 

11 

9 

10 

8 

7 

5 

0 

3 

5 

6 

7 

6 

0 

0 

8 

8 

7 

7 

10 

9 

8 

6 

9 

74  60  53  51  48 


8 

5 

15 

8 

7 

6 

9 

11 

4 

5 

6 

9 

10 

0 

12 

8 

8 

8 

11 

5 

0 

6 

5 

6 

12 

0 

0 

6 

9 

8 

13 

5 

9 

8 

7 

8 

14 

0 

0 

8 

7 

7 

100      5  100      9  100    22  100    23  100     23 

Average 

percent.  7.1  7.1  7.1  7.1  7.1 

Total  accurate 
columns  19  33  50  60  no 
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TABLE  XI  (Continued) 
Seventh  and  Eighth  Grades — Per  Cent,  of  Columns  Attempted 

Case  32  Case  52  Case  215         Case  2q8         Case  336 

Period         Per  Cent.        Per  Cent.        Per  Cent.        Per  Cent.        Per  Cent. 

1  8  4  3  4  5 

2  66254 

3  5  3  3  5  4 

19  13  8  14  13 


4 

5 

3 

3 

6 

5 

5 

6 

6 

2 

4 

5 

6 

6 

6 

1 

5 

4 

7 

5 

4 

3 

6 

4 

8 

5 

6 

3 

6 

4 

9 

6 

4 

4 

4 

4 

10 

4 

3 

4 

5 

4 

11 

4 

3 

6 

5 

4 

60  48  34  55  47 


12 

3 

6 

7 

4 

5 

13 

6 

6 

8 

4 

4 

14 

4 

4 

8 

5 

4 

15 

5 

3 

6 

4 

4 

16 

5 

3 

6 

4 

4 

17 

4 

6 

6 

5 

4 

18 

3 

6 

6 

4 

4 

19 

3 

6 

5 

4 

4 

20 

3 

6 

5 

5 

4 

21 

3 

6 

4 

6 

4 

100      9  100     18  100     14  100     15  100     12 


Average 
percent.  4.7  4.7  4.7  4-7  4-7 

Total  columns 
attempted  77  89  133  160  223 
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TABLE  XI  (Continued) 
Seventh  and  Eighth  Grades — Per  Cent,  of  Total  Accurate  Columns 


Case  20 

Case  64 

Case  208 

Case  304 

Case  343 

riod 

Per  Cent. 

Per  Cent. 

Per  Cent. 

Per  Cent. 

Pet  Cent. 

I 

10 

10 

2 

5 

4 

2 

10 

10 

5 

5 

4 

3 

12 

4 

2 

5 

5 

32  24  9  15 


4 

7 

6 

3 

5 

6 

5 

5 

6 

6 

4 

4 

6 

3 

6 

6 

5 

5 

7 

5 

4 

3 

4 

4 

8 

7 

8 

6 

5 

4 

9 

0 

0 

3 

4 

5 

10 

3 

6 

6 

5 

4 

62  58  42  47 


II 

5 

4 

6 

4 

6 

12 

0 

4 

6 

5 

4 

13 

3 

5 

3 

5 

6 

14 

3 

3 

5 

5 

5 

15 

3 

4 

5 

5 

5 

16 

0 

2 

6 

5 

4 

17 

4 

4 

5 

5 

5 

18 

5 

2 

5 

4 

6 

19 

3 

4 

5 

5 

6 

20 

5 

6 

6 

5 

4 

21 

7 

4 

6 

6 

4 

100    15         100    14         100    17         100    16         100    I 


Average 
percent.  4.7  4.7  4.7  4.7  4.7 

Total  of  accu- 
rate columns       40  52  88  135  242 
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Fatigue  As  Related  to  Total  Performance 

The  purpose  of  this  manner  of  handling  the  materials  of  the 
experiment  is  to  see  whether  the  work  curve  would  be  the  same  for 
those  who  accomplish  much  and  for  those  who  accomplish  little 
in  the  total  time;  or  whether  the  better  workers  fatigue  more  or 
less  rapidly  than  the  poorer  workers. 


Third  andTourtb  Qnadc  Cpoap  divided  into  Tenths 
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The  two  groups  are  divided  into  sub-groups  on  the  basis  of  the 
total  amount  done  in  twenty-eight  and  forty-two  minutes  respec- 
tively. The  368  children  of  the  Third  and  Fourth  grades  were 
arranged  in  rank  order  from  lowest  to  highest,  according  to  the 
total  attempted  in  the  twenty-eight  minutes,  and  again  according 
to  the  total  accurate  in  the  twenty-eight  minutes,  and  this  rank 
order  arrangement  was  cut  into  ten  parts.  Each  tenth  of  the  368 
makes  a  sub-group,  the  sub-groups  running  from  lowest  to  highest 
or  upper  tenth.  The  average  of  each  sub-group  was  determined 
and  curves  were  formed  for  these  ten  sub-groups.    There  are  twenty 
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curves  for  the  Third  and  Fourth  grades.  Likewise,  there  are 
twenty  curves  for  the  Seventh  and  Eighth  grades.  The  343  chil- 
dren in  this  group  were  arranged  in  rank  order  from  lowest  to 


* 


1 


J L 


J I I I L 


Fi$..£~  Attempts. 


highest  tenth  or  upper  tenth,  as  in  the  case  of  the  Third  and  Fourth 
grades  and  the  numbers  were  treated  in  the  same  way. 

These  curves  are  handled  in  much  the  same  way  as  the  larger 
group  curves.  The  idea  here  is  to  see  if  there  is  any  difference  in 
the  form  of  a  curve  for  a  poor  total  accomplishment  from  that  of 
the  better  accomplishment. 
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TABLE  XII 

Attempts  of  Third  and  Fourth  Grades 

The  368  cases  are  divided  into  ten  groups  on  the  basis  of  total  amount 

done  in  twenty-eight  minutes,  going  from  lowest  tenth  to 

upper  tenth.    Below  are  given  the  averages  for  each 

First  (Lowest)  Tenth— 37  Cases 
Period   Average      A.D.       P.E. 


1 

2 

3 

4 

5 
6 

7 
8 

9 
10 

11 

12 

13 
»4 


52 

75 

5 

63 

*7 

59 

19 

59 

44 

56 

36 

67 

22 

49 

33 

60 

22 

42 

36 

61 

22 

46 

33 

51 

38 

59 

08 

39 

II 

09 
08 

08 

08 

09 

07 
08 

06 

09 
06 

07 
07 
05 


Third  Tenth— 37  Cases 
Period   Average      A.D.      P.E. 


I 

243 

71 

1 

2 

2.29 

64 

09 

3 

2.49 

5* 

08 

4 

*  37 

54 

08 

5 

24 

6 

09 

6 

2.52 

49 

07 

7 

2.27 

54 

07 

8 

24 

56 

.08 

9 

245 

58 

.08 

10 

2.29 

53 

07 

11 

2-37 

55 

07 

12 

2.02 

47 

07 

13 

2.21 

29 

04 

14 

2.08 

6 

.08 

Second  Tenth — 

37  Cases 

Period 

Average      / 

[.D. 

P.E. 

1 

1.84 

55 

.08 

2 

1.98 

41 

.06 

3 

1.98 

31 

.03 

4 

1.87 

■41 

.06 

5 

1.76 

51 

.08 

6 

1.82 

46 

.06 

7 

2.0 

27 

.1 

8 

19 

42 

.06 

9 

1.92 

5 

.07 

10 

2.05 

45 

.06 

11 

2.05 

3 

.04 

12 

1.85 

.46 

.06 

13 

2.02 

36 

05 

14 

2.08 

6 

.08 

Fourth  Tenth — 37  Cases 

Period 

Average      /. 

1.0. 

P.E. 

1 

2-43 

.66 

09 

2 

2.92 

55 

.08 

3 

3  16 

47 

.07 

4 

2.84 

6 

.08 

5 

2.63 

.61 

.09 

6 

279 

54 

.08 

7 

243 

,6 

.08 

8 

2.76 

47 

.07 

9 

2.79 

56 

.08 

10 

29 

47 

.07 

11 

302 

■52 

.08 

12 

2.71 

79 

.11 

13 

273 

54 

.08 

14 

2.71 

59 

.08 
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TABLE  XII  (Continued) 
Attempts  of  Third  and  Fourth  Grades 


Fifth  Tenth— 37  Cases 

Sixth  Tenth — 37  Cases 

Period 

Average      A 

L.D. 

P.E. 

Period 

Average      A.D.       P.  E. 

I 

2-95 

.88 

.12 

1 

343 

79 

.11 

2 

3- 4i 

5 

.07 

2 

3 

.64   • 

.68 

.10 

3 

329 

45 

.06 

3 

3 

7 

58 

.08 

4 

3-24 

51 

.07 

4 

3 

79 

50 

07 

5 

305 

.46 

.06 

5 

3 

43 

59 

08 

6 

3-35 

59 

.08 

6 

3 

.62 

.52 

07 

7 

3- 

37 

05 

7 

3 

51 

■58 

08 

8 

31 

52 

.07 

8 

3 

57 

.6 

08 

9 

3  05 

46 

.06 

9 

3 

64 

56 

08 

IO 

3  32 

58 

.08 

10 

3 

37 

65 

09 

ii 

3.13 

51 

.07 

11 

3 

45 

68 

.10 

12 

2.92 

5 

.07 

12 

3 

27 

55 

08 

13 

321 

54 

.08 

13 

3 

76 

.61 

09 

14 

305 

75 

.10 

14 

3 

32 

.76 

.10 

Seventh  Tenth — 

37  Cases 

Eighth  Tenth—, 

37  Cases 

Period 

Average      A 

.D. 

P.E. 

Period 

Average      A 

L.JP-.      P.E. 

i 

337 

76 

.11 

1 

4.29 

85 

,12 

2 

3-86 

61 

.09 

2 

4 

.02 

.69 

.10 

3 

3-92 

40 

.06 

3 

4 

34 

64 

09 

4 

3  86 

53 

07 

4 

4 

29 

64 

09 

5 

357 

62 

.09 

5 

4 

16 

56 

.08 

6 

3  98 

41 

.06 

6 

4- 

40 

63 

09 

7 

3  92 

62 

.09 

7 

4 

13 

67 

.10 

8 

405 

46 

.06 

8 

4 

56 

79 

.11 

9 

4.18 

5 

•  07 

9 

4 

64 

75 

10 

IO 

4.16 

52 

07 

10 

4- 

29 

79 

11 

ii 

4  05 

46 

.06 

11 

4- 

32 

61 

09 

12 

387 

55 

.08 

12 

3 

94 

67 

093 

13 

4.02 

47 

.07 

13 

4 

16 

64 

089 

14 

405 

46 

.06 

H 

4 

34 

93 

132 

INDIVIDUAL  DIFFERENCES 
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TABLE  XII  (Continued) 
Attempts  of  Third  and  Fourth  Grades 


Ninth  Tenth— 36  Cases 
Period   Average      A.  D.       P.E. 


1 

2 

3 

4 

5 
6 

7 
8 

9 
10 

11 

12 

13 
14 


4 
4 
4 
5 
4 
4 
4 
4 
4 
5 
5 
4 
4 
4 


.21 

85 

.61 

.71 

58 

79 

.22 

65 

.62 

61 

.89 

50 

8l 

65 

95 

58 

78 

72 

36 

7 

.00 

55 

.64 

73 

.78 

67 

44 

78 

12 

10 

II 

09 

09 

07 

09 
08 

10 
10 

08 

10 

09 

II 


Tenth  Tenth— 36  Cases 


Period  Average 

1  516 

2  575 

3  6.05 

4  6.25 

5  5-78 

6  5  39 

7  6.61 

8  6.58 

9  6.92 

10  6.75 

11  6.36 

12  6.52 

13  6.41 

14  6.70 


D. 

18 
11 

13 

13 
22 

09 

57 

47 
60 

56 

94 
42 
48 
44 


P.E. 

•17 
.16 

.16 

.16 

.17 

15 
.22 

.20 

.22 

.22 

•13 
.20 

.20 

.20 


TABLE  XIII 
Accurates  of  Third  and  Fourth  Grades 

The  368  cases  are  divided  into  ten  groups  on  the  basis  of  total  amount 

done  in  twenty-eight  minutes,  going  from  lowest  tenth  to  upper 

tenth.    Below  are  given  the  averages  for  each  group 

Second  Tenth — 37  Cases 


Firs 

t  (Lowest)  Tenth— 37 

Cases 

m 

I    Average      A 

.D. 

P.E 

I 

13 

26 

.04 

2 

36 

49 

.06 

3 

27 

40 

.06 

4 

24 

36 

•05 

5 

29 

43 

.06 

6 

32 

43 

.06 

7 

.21 

34 

05 

8 

.16 

27 

.04 

9 

.40 

56 

.08 

10 

.21 

34 

05 

11 

.21 

34 

05 

12 

.21 

33 

05 

13 

24 

52 

.08 

14 

.18 

31 

04 

Period    Average      A 

\.D. 

P.E. 

1 

37 

56 

.08 

2 

81 

77 

.11 

3 

81 

65 

.09 

4 

5i 

58 

.08 

5 

67 

58 

.08 

6 

70 

57 

.08 

7 

78 

59 

.08 

8 

59 

57 

.08 

9 

48 

52 

.08 

10 

72 

67 

09 

11 

40 

54 

.08 

12 

59 

67 

.09 

13 

.62 

60 

.08 

14 

43 

58 

.08 
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TABLE  XIII  (Continued) 
Accurates  of  Third  and  Fourth  Grades 


Third  Tenth— 37  Cases 

Fourth  Tenth— 37  Cases 

Period   Average      A 

I.  D.      P.  E. 

Period    Average 

A.D.      P.E. 

I 

•59 

64 

08 

1 

1.26 

.82 

11 

2 

1. 18 

81 

11 

2 

1 

40 

.83 

11 

3 

1. 13 

58 

08 

3 

1 

37 

1.1 

15 

4 

1. 00 

7 

1 

4 

1 

43 

.66 

09 

5 

105        1. 

3 

18 

5 

1 

13 

73 

10 

6 

.91 

59 

08 

6 

1. 

24 

.65 

09 

7 

•75 

65 

08 

7 

1 

24 

.71 

10 

8 

1.08        1. 

00 

14 

8 

1 

43 

74 

10 

9 

97 

57 

08 

9 

1 

05 

.56 

08 

IO 

.78 

72 

10 

10 

1 

18 

.78 

11 

II 

.82 

.60 

08 

11 

1 

55 

.76 

11 

12 

.89 

74 

10 

12 

72 

.76 

11 

13 

.64 

73 

IO 

13 

1 

.21 

79 

11 

14 

.86 

56 

.08 

14 

90 

.67 

.09 

Fifth  Tenth— 3 

7  Cases 

Sixth  Tenth- 

— 37  Cases 

Period   Average      A 

l.D.      P.E. 

Period 

Average 

A.D.        P.E. 

I 

1.55 

74 

.10 

1 

1.90 

1.04 

15 

2 

71 

78 

.10 

2 

1-95 

.88 

.12 

3 

79 

78 

.10 

3 

2.18 

.91 

.12 

4 

79 

77 

.10 

4 

2.00 

.70 

.10 

5 

55 

74 

.10 

5 

2.08 

.64 

09 

6 

87 

76 

.10 

6 

2.29 

.80 

.11 

7 

43 

66 

09 

7 

1-95 

77 

.11 

8 

60 

74 

.10 

8 

1.87 

1. 01 

14 

9 

60 

90 

13 

9 

1.68 

.80 

11 

IO 

45 

79 

10 

10 

2.02 

84 

11 

ii 

65 

68 

09 

11 

1-73 

.98 

14 

12 

18 

63 

09 

12 

1.63 

71 

10 

13 

68 

61 

09 

13 

1.73 

75 

11 

14 

49 

85 

13 

14 

1.63 

1.03 

14 
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TABLE  XIII  (Continued) 
Accurate*  of  Third  and  Fourth  Grades 


Sepenth  Tenth— 37  Cases 


Eighth  Tenth— 37  Cases 


Period 

Average 

A.D.      P.E. 

Period 

Average 

A.D.        P.E. 

1 

1  89 

.  00 

13 

l 

2.49 

1.04 

.15 

2 

2.71 

1. 00 

14 

2 

2.79 

1. 02 

14 

3 

2.73 

1. 03 

"4 

3 

316 

74 

.10 

4 

2.73 

.72 

EO 

4 

2.98 

.89 

.12 

5 

1  79 

.61           .< 

*9 

5 

2.79 

.86 

.12 

6 

2.52 

.84           .1 

[I 

6 

300 

.64 

09 

7 

2.10 

.62           .< 

59 

7 

2.68 

.88 

.12 

8 

2.21 

.83           .1 

[I 

8 

2.82 

1. 01 

■14 

9 

2.44 

.88           .1 

13 

9 

3.02 

79 

.10 

10 

2.60 

.79           .1 

10 

10 

2.84 

1.06 

14 

11 

2.27 

.92           .] 

[2 

11 

295 

.72 

.10 

12 

2.08 

.91           .1 

[2 

12 

2.29 

.86 

.12 

13 

*  35 

.84           .] 

n 

13 

279 

97 

14 

«4 

2.16 

.80           .1 

[i 

14 

2.29 

•74 

.10 

Ninth  Tenth— 36  Cases 

Tenth  Tenth- 

—36  Cases 

Period 

Average 

A.D.       P.E. 

Period 

Average 

A.  D.       P.  E. 

1 

2.73 

1.04 

15 

1 

384 

96 

13 

2 

3  57 

85 

.12 

2 

4 

5 

1. 16 

16 

3 

3  33 

.88 

.12 

3 

4 

78 

1.02 

15 

4 

3  63 

.82 

.12 

4 

4 

41 

1. 19 

17 

5 

3  27 

.82 

.12 

5 

4 

19 

•93 

12 

6 

3.10 

73 

10 

6 

4 

67 

1.03 

15 

7 

3  13 

•74 

.10 

7 

4 

47 

1.02 

15 

8 

4.08 

136 

19 

8 

4 

73 

.82 

12 

9 

3  27 

1.05 

15 

9 

4 

89 

.96 

14 

10 

316 

.86 

.12 

10 

4 

55 

1.05 

15 

11 

3  45 

.91 

.12 

11 

4 

33 

1. 14 

16 

12 

308 

.82 

.12 

12 

4 

25 

1-34 

19 

13 

3  40 

•99 

14 

13 

4 

08 

1.36 

19 

14 

3*7 

1. 01 

15 

14 

4 

30 

1.29 

18 
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TABLE  XIV 
Attempts  of  Seventh  and  Eighth  Grades 

The  343  cases  are  divided  into  ten  groups  on  the  basis  of  total  amount 

done  in  forty-two  minutes,  going  from  lowest  tenth  to  upper 

tenth.  Below  are  given  the  averages  for  each  group 


First  (Lowest)  Tenth — 3$  Cases 

Second  Tenth 

— 3$  Cases 

Period 

Average      / 

[.D.      P.E. 

Period 

Average 

A.D. 

P.E 

1 

3.71         1 

13 

.16 

1 

4  65 

1.24 

19 

2 

3  4* 

.89 

13 

2 

4 

85 

89 

13 

3 

337 

■65 

.09 

3 

4 

.00 

•74 

.10 

4 

366 

87 

.12 

4 

4 

14 

63 

09 

5 

3.17 

.68 

.10 

5 

4 

88 

1.02 

.14 

6 

355 

73 

II 

6 

4 

.20 

.60 

.09 

7 

3-17 

.61 

09 

7 

3 

95 

.50 

.07 

8 

308 

63 

09 

8 

4 

.00 

.1&o 

.12 

9 

320 

56 

.08 

9 

4 

.11 

.61 

.09 

10 

3-40 

■57 

.08 

10 

4 

33 

.58 

.08 

11 

3.15 

■  57 

08 

11 

4 

.22 

•73 

.10 

12 

2.83 

.64 

09 

12 

3 

83 

.48 

.07 

13 

322 

55 

08 

13 

4 

17 

.80 

.12 

14 

3  09 

.68 

10 

14 

3 

8 

67 

.10 

15 

2.87 

.64 

09 

15 

4 

34 

.84 

.12 

16 

325 

70 

10 

16 

4 

31 

.83 

.11 

17 

331 

77 

11 

17 

4 

58 

72 

.10 

18 

306 

70 

10 

18 

4 

11 

.82 

.12 

19 

357 

98 

14 

19 

3 

75 

67 

.10 

20 

3-57 

.84 

12 

20 

4 

31 

85 

.12 

21 

2.86 

65 

09 

21 

4 

85 

1.05 

15 

Third  Tenth — 34  Cases 

Fourth  Tenth 

— 34  Cases 

Period 

Average      /. 

LD.      F 

\E. 

Period 

Average 

A.D. 

P.E 

1 

4.88 

76 

09 

1 

4.89 

103 

.14 

2 

4-74 

62 

12 

2 

4 

86 

.51 

07 

3 

483 

68 

11 

3 

4 

94 

.66 

.19 

4 

4.68 

57 

12 

4 

5 

21 

•57 

.08 

5 

3.88 

53 

11 

5 

4 

74 

63 

•09 

6 

4.68 

57 

07 

6 

5 

11 

•73 

.10 

7 

4.21 

69 

11 

7 

5 

02 

•51 

07 

8 

4-77 

68 

09 

8 

4 

94 

67 

.10 

9 

4.71 

71 

07 

9 

5 

00 

•70 

.10 

10 

4.98 

57 

08 

10 

5 

06 

78 

.11 

11 

479 

71 

10 

11 

5 

06 

50 

.07 

12 

438 

56 

08 

12 

5 

16 

.80 

.11 

13 

500 

52 

10 

13 

5 

52 

1.09 

•  15 

INDIVIDUAL  DIFFERENCES 
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TABLE  XIV  (Continued) 
Attempts  of  Seventh  and  Eighth  Grades 


Third  Tenth— 34  Cases 


t           • 

I   Average      A.  D. 

P.E 

14 

4  17 

63 

.10 

15 

4.62 

75 

.10 

16 

4  74 

49 

.08 

17 

4-77 

76 

.08 

18 

4  65 

86 

.08 

19 

4  44 

72 

.10 

20 

4«3 

.86 

09 

21 

3  59 

61 

.11 

Fifth  Tenth— 34  Cases 
Period   Average       A.D.        P.E. 


I 

5 

53 

1.34 

19 

2 

5. 

09 

.86 

12 

3 

5 

4i 

.69 

10 

4 

5 

62 

75 

11 

5 

4 

97 

.86 

12 

6 

5 

59 

.67 

10 

7 

5 

05 

•72 

10 

8 

5 

53 

73 

11 

9 

5 

68 

.62 

09 

10 

5 

89 

.86 

12 

11 

5 

68 

83 

12 

12 

5 

45 

.64 

09 

13 

5 

71 

•75 

11 

14 

5 

38 

.62 

09 

15 

6 

*9 

1. 18 

17 

16 

5 

74 

.84 

12 

17 

5 

71 

70 

.10 

18 

5 

45 

•7* 

.10 

19 

4 

42 

1.06 

15 

20 

5 

17 

1.04 

.15 

21 

5 

38 

.81 

.12 

Seventh  Tenth — 34  Cases 

Period 

Average 

A.D.        1 

\E 

I 

6.26 

1. 00 

•14 

2 

6.17 

75 

.11 

3 

6.32 

.92 

.13 

4 

6.26 

70 

.10 

5 

5 

74 

67 

.10 

Fourth  Tenth— 34  Cases 
Period    Average      A.D.       P.E. 


14 

5-17 

.80 

12 

15 

526 

85 

12 

16 

529 

.86 

.12 

17 

521 

67 

19 

18 

4.12 

1.04 

15 

19 

4-53 

99 

14 

20 

523 

1. 11 

.16 

21 

4.86 

.69 

.10 

Sixth  Tenth- 

-35  Cases 

Period 

Average 

A.  D.        P.  E. 

1 

598 

1.29 

19 

2 

575 

.62 

09 

3 

589 

•73 

.11 

4 

580 

58 

.08 

5 

552 

75 

.11 

6 

5  92 

•  63 

09 

7 

572 

94 

14 

8 

5  92 

.84 

.12 

9 

5  63 

.56 

08 

10 

6.08 

85 

.12 

11 

592 

.48 

07 

12 

589 

•  56 

.08 

13 

6.02 

•49 

07 

14 

6.20 

.68 

.10 

15 

6.22 

1.06 

•15 

16 

578 

.68 

.10 

17 

5-92 

74 

.11 

18 

6.17 

83 

.12 

19 

580 

•58 

.08 

20 

6.36 

.90 

13 

21 

6.22 

74 

.11 

Eighth  Tenth 

— 34  Cases 

Period 

Average 

A.D.        P.E. 

1 

729 

.98 

13 

2 

6.68 

.92 

•13 

3 

6.77 

•59 

.08 

4 

6.95 

•72 

.10 

5 

6.41 

.62 

.09 
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TABLE  XIV  (Continued) 
Attempts  of  Seventh  and  Eighth  Grades 


Seventh  Tenth— 34  Cases 
Period    Average      A.  D.        P.E. 


Eighth  Tenth— 34  Cases 
Period    Average       A.  D.        P.E. 


6 

6.38 

.86 

.12 

6 

6.62 

.62 

09 

7 

6-33 

•74 

11 

7 

6-45 

65 

09 

8 

6.35 

.84 

.12 

8 

705 

.66 

.10 

9 

592 

52 

07 

9 

6.71 

59 

08 

10 

6.23 

.81 

.12 

10 

6.80 

.61 

09 

11 

6.32 

77 

.11 

11 

6.83 

.61 

09 

12 

6.00 

.76 

II 

12 

6.59 

.64 

09 

13 

6.48 

.88 

13 

13 

6.74 

.62 

09 

14 

6.98 

97 

14 

14 

6.38 

99 

14 

15 

723 

1. 14 

16 

15 

755 

1. 00 

14 

16 

6.44 

.87 

13 

16 

6-95 

.78 

.11 

17 

6.58 

93 

13 

17 

7.21 

.89 

13 

18 

6.41 

.72 

10 

18 

6.69 

78 

.11 

19 

568 

.86 

.12 

19 

6.62 

70 

.10 

20 

6.26 

1. 19 

17 

20 

7.05 

78 

.11 

21 

6.35 

1.02 

15 

21 

6.92 

.98 

14 

Ninth  Tenth— 34  Cases 
Period  Average       A.  D.        P.  E. 


Tenth  Tenth — 34  Cases 
Period    Average       A.D.        P.  E. 


I 

783 

1. 13 

.16 

1 

9  29     i 

[.26  . 

.18 

2 

6.83 

93 

13 

2 

8.61     ] 

t-15 

17 

3 

759 

78 

.11 

3 

8.86     ] 

[.18 

17 

4 

750 

79 

.11 

4 

944     1 

1.31 

19 

5 

7.14 

71 

.10 

5 

8.92     1 

t-39 

20 

6 

7.29 

•59 

.08 

6 

8.89     ] 

[.09 

16 

7 

7.41 

.83 

.12 

7 

8.98     ] 

[.15 

17 

8 

7.76 

.92 

13 

8 

895     1 

[.12 

16 

9 

7.26 

69 

.10 

9 

8.83     1 

[.04 

15 

10 

765 

.82 

12 

10 

938     1 

t.25 

18 

11 

7-74 

•  78 

.11 

11 

927     i 

[.30 

19 

12 

725 

•78 

.11 

12 

952     1 

[.61 

23 

13 

7.62 

79 

11 

13 

9-77     1 

[.60 

23 

14 

745 

.88 

13 

14 

995     1 

[.41 

.20 

15 

8.27 

1.48 

21 

15 

10. 11     ] 

[.60 

23 

16 

7.02 

.62 

09 

16 

9.68     ] 

1-73 

25 

17 

6.77 

79 

11 

17 

9.98     ] 

t.50 

.22 

18 

7.28 

105 

15 

18 

10.44    - 

!.l8 

31 

19 

729 

1. 01 

14 

19 

10. 11     ] 

r.56 

.22 

20 

7  92 

65 

09 

20 

10.14    : 

J. 09 

30 

21 

8.14 

1.25 

.18 

21 

10.79    : 

'•59 

37 

INDIVIDUAL  DIFFERENCES 
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TABLE  XV 

Accurates  of  Seventh  and  Eighth  Grades 

The  343  cases  are  divided  into  ten  groups  on 

the  basis  of  total  amount 

done  in 

forty-two  minutes,  going 

from  lowest  tenth  to  upper 

tenth.    Below  are 

i  given  the 

averages  for  each  group 

First  (Lowest)  Tenth— 35  Cases 

Second  Tenth 

— 35  Cases 

Period 

Average 

A.  D.        P.  E. 

Period    Average 

A.  D.        P.  E. 

I 

1.43 

1.42 

07 

1 

2.22 

1. 00 

14 

2 

86 

137 

06 

2 

237 

.98 

14 

3 

77 

1. 19 

05 

3 

2.20 

1.09 

16 

4 

80 

.96 

04 

4 

2.40 

1. 00 

14 

5 

49 

1. 01 

05 

5 

2-55 

.62 

09 

6 

89 

9« 

04 

6 

2.49 

52 

07 

7 

67 

1.03 

06 

7 

2.08 

.96 

13 

8 

52 

.92 

04 

8 

2.69 

1.23 

17 

9 

80 

.88 

04 

9 

2.40 

85 

12 

10 

2. 

17 

.85 

04 

10 

2.75 

73 

10 

11 

83 

83 

04 

11 

243 

•93 

13 

12 

.02 

.66 

03 

12 

2.20 

77 

11 

13 

54 

1.04 

06 

13 

245 

•94 

13 

14 

45 

97 

04 

14 

2.00 

85 

12 

15 

40 

97 

04 

15 

2.45 

•92 

13 

16 

.58 

.82 

04 

16 

2.31 

1. 15 

16 

17 

.48 

1.04 

.06 

17 

2.28 

1.04 

15 

18 

.22 

.84 

04 

18 

234 

1.02 

15 

19 

37 

95 

04 

19 

2.02 

83 

12 

20 

31 

93 

04 

20 

2.05 

.81 

.12 

21 

14 

.71 

03 

21 

2.20 

1.08 

16 

4 

Third  Tenth — 34  Cases 

Fourth  Tenth 

— 34  Cases 

Period 

Average 

A.D.        1 

\E. 

Period    Average 

A.D.        1 

\E. 

1 

3  3* 

1.06 

.18 

1 

3-35 

1. 10 

.16 

2 

*  95 

.88 

.12 

2 

3 

36 

78 

.11 

3 

326 

.80 

.12 

3 

3 

17 

1. 10 

.16 

4 

3  41 

.82 

.12 

4 

3 

48 

.82 

.12 

5 

3  08 

99 

.14 

5 

3 

44 

79 

.10 

6 

3  05 

1.06 

15 

6 

3 

50 

.82 

.12 

7 

300 

94 

13 

7 

3 

23 

84 

.12 

8 

2.89 

1.09 

.16 

8 

3 

71 

•  92 

■13 

9 

2.74 

.91 

.13 

9 

3 

23 

87 

.12 

10 

3  17 

105 

.16 

10 

3 

53 

1.05 

15 

II 

3  17 

1.09 

.16 

11 

3 

68 

•94 

•13 

12 

2-54 

1. 13 

.16 

12 

3 

17 

•95 

•14 

13 

3 

14 

.88 

•13 

13 

3 

75 

1.27 

.18 
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TABLE  XV  (Continued) 
Accurates  of  Seventh  and  Eighth  Grades 


Third  Tenth— 34  Cases 


Period   Average 

2.69 

2-74 
2.66 


14 

15 
16 

17 
18 

19 
20 

21 


308 
2.83 
2.44 
2.71 

2.77 


Fifth  Tenth- 
Period  Average 


1 

2 

3 

4 

5 
6 

7 
8 

9 
10 

11 

12 

13 

14 

15 
16 

17 
18 

19 
20 

21 


4.09 

368 

356 

458 

359 
368 

377 

3-65 

391 
380 

4.00 

340 
350 
380 
3-86 
362 
380 

3-65 

311 

3-59 
320 


A.D. 
1.08 

89 
105 

1.06 

.84 

1.02 

•93 
1.02 

-34  Cases 
A.D. 

1. 10 
1.20 

•93 
.78 

.96 

98 
.90 
.90 

78 

•94 

1. 11 

1.08 

97 
1. 19 

1.06 

97 
.80 

123 

.96 

1. 41 

1. 41 


P.E. 

16 

13 
15 
15 
13 
15 
13 
15 


P.E. 
16 

15 

13 
11 

13 

14 

13 

13 
11 

13 
16 

15 

14 

17 

15 

14 
12 

18 

14 
20 

20 


Seventh  Tenth — 34  Cases 


ocvemn  1  c 

Period  Average 

1  4.66 

2  458 

3  489 

4  509 

5  5-06 


A.D. 

P.E 

1.55 

.22 

1.29 

19 

1. 17 

17 

.96 

.13 

Fourth  Tenthr-34  Cases 


.84 


.12 


Period 

Average 

A.D.       F 

\E. 

14 

295 

95 

14 

15 

3 

38 

1. 01 

15 

16 

3 

53 

•  99 

14 

17 

3 

59 

99 

14 

18 

3 

33 

1.09 

15 

19 

3 

11 

.76 

11 

20 

3 

14 

1.30 

19 

21 

3 

11 

1. 18 

16 

Sixth  Tenth- 

—35  Cases 

Period 

Average 

A.D.       P.E. 

1 

398 

1  49 

.21 

2 

444 

1. 11 

16 

3 

4-17 

103 

15 

4 

389 

1. 01 

15 

5 

367 

1.30 

19 

6 

4. 11 

1. 14 

.16 

7 

4.26 

1.20 

17 

8 

4.80 

1. 12 

16 

9 

436 

•94 

H 

10 

4. 11 

1.20 

.17 

11 

4.62 

95 

14 

12 

4.00 

.68 

.10 

13 

450 

1. 18 

16 

14 

368 

1. 10 

16 

15 

423 

1. 21 

17 

16 

4.00 

1. 14 

.16 

17 

4.14 

93 

13 

18 

4.26 

1.22 

.18 

19 

4. 11 

77 

.11 

20 

4  13 

1. 01 

15 

21 

4.12 

1.30 

19 

Eighth  Tenth 

— : 34  Cases 

Period 

Average 

A.D.        1 

\E. 

1 

529 

1. 12 

17 

2 

4.92 

76 

.11 

3 

505 

1. 12 

.16 

4 

5-44 

105 

15 

5 

4 

83 

1. 19 

17 

INDIVIDUAL  DIFFERENCES 
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TABLE  XV  {Continued) 
Accurate  of  Seventh  and  Eighth  Grades 


Seventh  Tenth — 34  Cases 
Period   Average      A.D.        1 


6 

7 
8 

9 
10 

II 

12 

13 

14 

15 
16 

17 
18 

19 
20 

21 


5 

4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 
4 


03 
41 
77 
48 

38 
76 

23 

«3 
29 

74 
29 

74 
86 

26 

II 

00 


57 
I.04 

63 
1. 00 
1.25 

1. 31 
I.02 

1.07 

1.24 

1.20 

I.08 

1.02 

1.04 

1.28 

I.08 

I.29 


E. 

08 

15 

09 

14 

17 

19 

15 

15 

17 

17 
16 

15 

15 

17 
16 

18 


Eighth  Tenth— 34  Cases 
Period    Average       A.D.       P.E. 


6 

5 

50 

1.08 

16 

7 

5 

17 

93 

13 

8 

5 

58 

1  39 

19 

9 

5 

08 

1.06 

15 

10 

5 

59 

1.08 

16 

11 

5 

.00 

94 

13 

12 

4 

71 

1. 12 

16 

13 

5 

20 

.90 

13 

14 

4 

95 

1. 12 

16 

15 

5 

35 

1. 41 

16 

16 

5 

17 

1.29 

18 

17 

5 

58 

1.03 

15 

18 

4 

65 

1. 13 

16 

19 

4 

77 

.92 

13 

20 

5 

.11 

1. 18 

17 

21 

5 

.00 

1. 11 

16 

Ninth  Tenth— 34  Cases 
Average       A.D.        P.  E. 


Tenth  Tenth — 34  Cases 
Period    Average       A.D.        P.E. 


1 

2 

3 

4 

5 
6 

7 
8 

9 
10 

II 

12 

13 

14 

15 
16 

17 
18 

19 
20 

21 


5 

5 

5 

5 

5 

5 

5 
6 

5 

5 

5 
6 

5 

5 

5 

5 
6 

5 
5 
5 
5 


95 
45 
95 
92 
59 

83 
86 

29 

92 

89 

95 
08 

83 
80 

24 
56 

23 
98 

83 
55 
77 


1.37 
1.09 

1. 00 

77 

1. 01 

98 

.82 

1. 01 

87 
1.06 

1. 12 

99 

.98 

1. 11 

1.22 

1. 16 

87 
1.09 

95 
1.08 

1.07 


19 
16 

14 
11 

15 

13 
12 

15 

13 

15 
16 

13 

13 
16 

17 
17 
13 
16 

13 
16 

15 


I 

759     1 

•43 

.20 

2 

7.13     1 

•25 

17 

3 

7  23    1 

•51 

.16 

4 

7.80    1 

36 

.20 

5 

7.14    1 

.08 

.16 

6 

6.89    1 

•49 

.20 

7 

7.08    1 

03 

15 

8 

6.92    1 

•27 

•17 

9 

6.98    1 

•15 

.16 

10 

7.42    1 

•45 

.20 

11 

8.02    1 

•33 

.20 

12 

735    1 

35 

.20 

13 

795    1 

•54 

.16 

H 

732    1 

43 

.20 

15 

8.32    1 

.66 

24 

16 

7.62    1 

29 

17 

17 

738    1 

74 

25 

18 

7-32    1 

•83 

.26 

19 

7.17    1 

.40 

.20 

20 

7.17    1 

.20 

.16 

21 

6.83    1 

•53 

.16 
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TABLE  XVI 

Third  and  Fourth  Grades, — Attempts 
Sub- 
Groups    I      II       IIIs     IV  V  VI        VII      VIII       IX 

i  i       14      1.43      1.26      12%  loss         1.37      1. 31       1.27      1. 00 

.95 
.92 

2  14        5      1.93      1.99        3%  gain        1.92       1.88      2.01       1.00 

97 
1.04 

3  6      12      2.40      2.10       12%  loss        2.40      2.41       2.19       1. 00 

1. 00 

91 
431       2.84      2.72      4%  loss  2.84      2.68      2.81       1. 00 

and  .94 

7  -99 

5  2       12      3.22      3.06        5%  loss        3.22      3. 11      3.13       1. 00 

.06 

97 

6  4       12      3.59      3.45        4%  loss        364      3.55      3.43       1. 00 

96 

•94 

7  9        1      3-72      3.98        7%  gain       3.75      394      403       1.00 

1.05 
1.07 

8  8       12      4.22      4.16        i%loss        4.24      4.40      4.22       1. 00 

1037 

99 

9  10        1      4.47      4.62        3%  gain       4.65      4.81      4.84      1. 00 

1034 
1.04 
10  9        1       5.65      6.54      16%  gain       5.80      6.36      6.55      1. 00 

1.09 

1. 13 

Third  and  Fourth  Grades — Accurates 

Sub- 
Groups     I       II       III        IV  V  VI        VII       VIII      IX 

I  9  I  .25  .21  16%  loSS  .25  .28  .21  1. 00 

1. 12 
.84 

2  2        1         .66         .55       17%  loss  .63         .64         .55        1. 00 

3  1. 00 

.87 
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TABLE  XVI  (Continued) 

Third  and  Fourth  Grades — Accurates 
Sulh 
Groups     I       II       III        IV  V  VI       VII       VIII      IX 

3  2        I         .97        .80      18%  loss  .98        .95        .80      1. 00 

.96 

.81 

4  11       12      1.34        .94      30%  loss        1.36      1.22      1. 11       1. 00 

.89 
.81 

5  6      12       1.68      1.45      14%  loss         1. 71       1. 61       1.49      1. 00 

•94 

87 

6  6       14      2.01       1.66      17%  loss        2.01       1.97      1.75      1. 00 

98 
.87 

7  3  5        2.44        2.20        10%  loss  2.51        2.21         2.29        I. OO 

4  .88 

91 

8  3      12      2.81      2.46      12%  loss        2.85      2.86      2.63      1. 00 

1.003 
.92 

9  8        1      3.21      3.25        i%gain       3.32      3.37      3.27      1.00 

1. 01 

98 
10  9        1      4.37      4.21        4%  loss        4.38      4.59      4.30      1. 00 

1.04 

.98 

TABLE  XVII 

Seventh  and  Eighth  Grades — Attempts 
Sub- 
Groups      I      II       III        IV  V  VI        VII      VIII       IX 

1  1       12      3.50      3.53        5%  loss        3.44      3.14      3.21       1. 00 

.91 
93 

2  5      19      4-50      4-30        5%  low        4.38      4.07      4.32      1. 00 

93 
98 

3  13      21      4.82      4.29      11%  loss        4.70      4.69      4.66      1. 00 

.99 

•99 

4  13      18      4.90      4.87        1  %  loss        4.97      5.13      4.93      1. 00 

1.03 

99 
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TABLE  XVII  (Continued) 

Seventh  and  Eighth  Grades — Attempts 
Sub- 
Groups    I       II       III       IV  V  VI        VII      VIII 

5        15      19      534      4  99        7%  loss        5.32      5.62      5.45 


6        20        5      5.87      6.13        4%  gain       5-8o      5-95      6.07 


7        15      19      6.25      6.10        2%  loss        6.21      6.23      6.42 


8        15      14      6.91      6.86        1  %  loss        6.74      6.73      7.01 


9        15      17      7.42      7.78        5%  gain       7.37      7.53      7.53 


10        21         2      8.92     10.35       16%  gain       9.10      9.38     10.18 


Seventh  and  Eighth  Grades — Accurates 
Sub- 
Groups    I       II       III        IV  V  VI        VII      VIII 

1    '     10       12       1.69       1.27      25%  loss         1.70       1.62       1.36 


2        10      14      2.26      2.09        8%  loss        2.33      2.42      2.23 


4       19      3.18      2.64      17%  loss        3.15      2.91       2.75 


4        13       14      3.29      3.12        5%  loss         3.36      3.43      3.31 


5  4       19      378      330      13%  loss        3.85      3.23      3.55 


6        5      4.20      4.12        2%  loss         4.07      4.29      4.14 


7         4      21      4.70      4.12      12%  loss        4.82      4.63      4.42 
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TABLE  XVII  (Continued) 
Seventh  and  Eighth  Grades — Accurates 


Sub- 
Groups    I       II  III  IV  V 

8         10       18  5.09  4.96  3%  loss 

982  5.78  5.72  ^  i%loss 

10        15      21  7.32  7. 11  3%  loss 


VI 

VII 

VIII 

IX 

517 

5.16 

509 

1. 00 

99 
.98 

5.79 

597 

5-88 

1. 00 
1.03 

1. 01 

7.27 

7-4^ 

7.42 

1. 00 
1.02 
1.02 

EXPLANATION  OF  TABLES  NOS.  XVI  AND  XVII 

In  these  tables  we  have  under 

I.  The  maximum  period  for  each  curve. 

II.  The  minimum  period  for  each  curve. 

III.  Average  columns  for  first  three  periods. 

IV.  Average  columns  for  last  three  periods. 

V.   Per  cent,  of  gain  or  loss  when  III  and  IV  are  compared  with  III  as  a  basis. 
VI.  Average  of  first  third  of  curve. 
VII.  Average  of  second  third  of  curve. 
VIII.  Average  of  last  third  of  curve. 
IX.  Relative  value  of  VI ,  VII ,  and  VIII,  using  VI  as  a  basis. 
The  figures  under  V  show  that  the  group  fatigued  or  did  not  fatigue — accord- 
ing as  there  was  loss  or  gain.    IX  gives  an  idea  of  the  general  form  of  the  curve. 

To  begin  with  the  facts  as  summarized  in  Table  XVI.  The 
location  of  the  maximum  (Column  I)  is  certainly  later  with  the 
better  workers,  when  attempts  are  considered,  in  either  the  Third 
and  Fourth  or  the  Seventh  and  Eighth  grades;  the  minimum,  on 
the  other  hand,  tends  to  come  earlier  with  the  better  groups  than 
with  the  poorer.  In  the  case  of  accurates,  no  clear  relation  appears 
between  the  location  of  the  maximum  or  minimum  and  the  total 
accomplishment. 

Column  V  shows  pretty  clearly  that  the  losses  tend  to  be  smaller 
towards  the  bottom  of  the  column,  which  means  that  the  better 
workers  fatigued  less  than  the  poorer  workers.  In  the  case  of 
attempts,  the  loss  actually  gives  way  to  a  gain,  while  in  the  case  of 
accurates,  the  best  workers  lose  very  little  at  the  end  as  compared 
with  the  beginning.  Column  IX,  attentively  considered,  will  show 
the  same  thing. 
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But,  undoubtedly,  the  best  presentation  of  the  results  is  afforded 
by  the  curves.1  The  curves  for  attempts,  in  both  the  younger  and 
the  older  group,  show  a  clear  general  rise  in  the  case  of  the  upper 
tenth,  indicating  that  the  best  workers  increased  their  speed  during 
the  experiment;   while  the  curve  for  the  lowest  tenth  shows  the 
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Fig.  Q.  Attempts — Third  and  Fourth  Grades 

EXPLANATION  OF  FIGURES  9-12 

The  points  on  these  curves  are  for  the  average  performances  for  every  four 
minutes,  the  data  being  handled  thus  so  as  to  smooth  out  the  curves. 

opposite  course.  The  curves  for  the  intervening  tenths  are  rather 
confusing,  but  apparently  have  no  definite  tendency  to  deviate 
much  from  the  horizontal — which  would  indicate  that,  on  the  whole, 
the  medium  workers  neither  increased  nor  decreased  their  speed. 

lSee  Figures  5.  6.  7.  and  8  on  pages  31,  3a,  33  and  34 
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The  curves  for  accurates  fail  to  reveal  to  the  eye  any  clear  dif- 
ference between  the  sub-groups. 

Evidently  we  have  made  too  many  sub-groups  in  dividing  into 
tenths.  While  highest  and  lowest  tenths  should  evidently  be  kept 
separate,  as  their  curves  stand  so  definitely  apart  from  the  rest, 
the  second  and  third  tenths  may  very  well  be  combined,  and  like- 
wise the  eighth  and  ninth,  leaving  the  four  middle  tenths  to  com- 
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Fig.  10.  Accurate* — Third  and  Fourth  Grades 


bine  into  one  central  group.  The  resulting  division  into  five 
unequal  parts  gives  approximately  equal  spaces  between  the  aver- 
ages of  the  adjacent  groups,  as  should  be  the  case  according  to  the 
theory  of  distribution,  and  as  appears  in  fact  to  be  the  case  in  the 
following  curves  constructed  as  above  indicated.  In  order  further 
to  eliminate  irrelevant  fluctuations,  the  points  on  the  curves  indi- 
cate the  averages  of  two  adjacent  periods  of  two  minutes.  The 
Tables,  XVIII  to  XXI,  give  the  averages  for  each  period.  Group  A, 
in  these  tables,  consists  of  the  lowest  tenth,  Group  B  of  the  second 
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and  third  tenths,  Group  C  of  the  fourth  to  seventh  tenths,  Group 
D  of  the  eighth  and  ninth,  and  Group  E  of  the  uppermost  tenth. 
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Fig.  ii.  Attempts — Seventh  and  Eighth  Grades 
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The  curves,  thus  reduced  to  their  lowest  terms,  indicate  pretty 
clearly  that  there  is  a  relation  in  attempts  between  speed  of  work 
and  liability  to  fatigue.  The  most  rapid  workers  increase  their 
speed  as  time  goes  by,  while  the  slowest  workers  fall  off,  the  middle 
groups  remaining,  on  the  average,  almost  perfectly  steady  for  the 
time  here  considered.  In  accurate  work,  the  general  tendency  of 
the  whole  group  was  shown  in  the  last  chapter  to  be  slightly  down- 
ward towards  the  end.    But  the  decline  comes  later  with  the  upper 
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group,  and  is  somewhat  less  pronounced  than  in  the  lowermost 
group,  at  least  when  the  decline  is  considered  in  relation  to  the 
height  of  the  curve  above  the  base  line.  This  is  brought  out  by 
another  way  of  examining  the  results. 
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Fig.  12.  Accurals — Seventh  and  Eighth  Grades 

As  heretofore,  the  first  three  periods  were  compared  with  the 
last  three  periods.    The  results  are  given  below : 

Third  and  Fourth  Grades 
A  ttempts  A  ccurates 

Group  A,  12  per  cent,  loss  Group  A,  16  per  cent,  loss 

Group  B,    5  per  cent,  loss  Group  B,  18  per  cent,  loss 

Group  C,    1  per  cent,  loss  Group  C,  18  per  cent,  loss 

Group  D,    1  per  cent,  gain  Group  D,    6  per  cent,  loss 

Group  E,  16  per  cent,  gain  Group  E,    4  per  cent,  loss 

Seventh  and  Eighth  Grades 
A  ttempts  A  ccurates 

Group  A,    5  per  cent,  loss  Group  A,  25  per  cent,  loss 

Group  Bv    8  per  cent,  loss  Group  B,  12  per  cent,  loss 

Group  C,    1  per  cent,  loss  Group  C,    8  per  cent,  loss 

Group  D,    2  per  cent,  gain  Group  D,    2  per  cent,  loss 

Group  Ev  16  per  cent,  gain  Group  E,    3  per  cent,  loss 
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TABLE  XVIII 
Attempts,  Third  and  Fourth  Grades 


Group  I 

Groups 

Groups  IV, 

Groups 

Group 

II,  III 

V,  VI,  VII, 

VIII,  IX 

4 

4 

B 

C 

D 

E 

I                                                  I 

52 

2.13 

3.04 

425 

5.16 

2                      I. 

50 

2.13 

3 

.46 

4 

3i 

575 

3                 I 

27 

2.23 

3 

52 

4 

4i 

6.05 

4                 I 

19 

2.12 

3 

43 

4 

75 

6.25 

5                 I 

44 

2.08 

3 

17 

4 

39 

578 

6                 I 

36 

2.17 

3 

43 

4 

65 

592 

7                 I 

.22 

2.17 

3 

21 

4 

47 

6.61 

8                 I 

33 

2.15 

3 

34 

4 

82 

6.58 

9                 I 

.22 

2.19 

3 

34 

4 

72 

6.92 

10                       I. 

36 

2.17 

3 

44 

4 

82 

6.75 

ii                 i. 

.22 

2.21 

3 

66 

4 

66 

6.36 

12                      I 

33 

i-95 

3 

19 

4 

29 

6.52 

13                 I 

38 

2. 11 

3 

43 

4 

48 

6.41 

14                 I 

08 

2.12 

3 

28 

4 

39 

6.70 

TABLE  XIX 
Accurates,  Third  and  Fourth  Grades 


Group  I 

Groups        Groups  IV, 
II,  III        V,  VI,  VII 

Groups 
VIII,  IX 

Group 

A 

B 

C 

D 

E 

I 

•13 

.51                 1 

65 

2.61 

384 

2 

•  35 

1. 00                1. 

94 

318 

4 

50 

3 

27 

97                2. 

02 

324 

4 

78 

4 

•24 

76                1. 

99 

330 

4 

41 

5 

29 

86                 1. 

64 

303 

4 

19 

6 

32 

.81                  1 

98 

305 

4 

67 

7 

.21 

77                1 

68 

2.90 

4 

47 

8 

.16 

86                 1 

78 

345 

4 

73 

9 

.40 

73                 1 

69 

3.14 

4 

89 

10 

.21 

77                 1 

.81 

300 

4 

55 

11 

.21 

.60                1 

.80 

3-20 

4 

33 

12 

.21 

74                1 

.40 

2.68 

4 

25 

13 

24 

63                 1 

74 

309 

4 

.08 

14 

.18 

.65                1 

■55 

2.78 

4 

30 
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TABLE  XX 
Attempts — Seventh  and  Eighth  Grades 


Group  I 

Groups 

Groups  IV, 

Groups 

Group 

II,  III 

V,  VI,  VII 

VIII,  IX 

A 

B 

C 

D 

E 

I 

3- 71 

477 

566 

756 

9.29 

2 

342 

4 

79 

5 

47 

675 

8.61 

3 

3  37 

4 

43 

5 

.64 

7.18 

8.86 

4 

366 

4 

41 

5 

72 

7.22 

9  44 

5 

3  17 

4 

38 

5 

24 

6.77 

8.93 

6 

3- 55 

4 

■44 

5 

75 

7-45 

8.89 

7 

3  17 

4 

.08 

5 

63 

6.93 

8.98 

8 

308 

4 

39 

5 

.68 

7.40 

8.95 

9 

320 

4 

41 

5 

55 

6.98 

8.83 

IO 

3  40 

4 

65 

5 

86 

7.22 

9  38 

ii 

3.15 

4 

50 

5 

74 

7.28 

9  77 

12 

2.83 

4 

11 

5 

60 

6.92 

9  52 

13 

322 

4 

59 

5 

93 

7.18 

9  77 

H 

3  09 

3 

99 

5 

93 

6.92 

9  95 

15 

2.87 

4 

48 

6. 

25 

791 

10. 11 

16 

325 

4 

52 

5- 

81 

6.98 

9.68 

17 

3.31 

4 

68 

5. 

«5 

6.94 

9  98 

18 

306 

4 

38 

5- 

54 

7  03 

10.44 

19 

357 

4 

09 

5- 

11 

6.95 

10. 11 

20 

357 

4 

57 

5- 

73 

7.48 

10.14 

21 

2.86 

4- 

22 

5- 

70 

753 

10.79 
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TABLE  XXI 

Accurate,  Seventh  and  Eighth  Grades 

Group  I 

Groups 

Groups  IV, 

Groups 

Group . 

11 ',  III 

V,  VI,  VII 

VIII,  IX 

A 

B 

C 

D 

E 

I                 I. 

43 

2.72 

4.02 

562 

7-59 

2                       I. 

86 

2.66 

4.01 

5 

19 

713 

3                 I 

77 

273 

389 

5 

50 

723 

4                 I 

8o 

2.90 

4.26 

5 

68 

7.80 

5                 ' 

49 

2.82 

4.19 

5 

21 

7.14 

6                 I. 

89 

2.77 

4.08 

5 

66 

6.89 

7                 i 

67 

2.54 

3-92 

5 

56 

7.08 

8                 I. 

52 

2.79 

424 

5 

94 

6.92 

9                 i 

8o 

2.57 

3  99 

5 

50 

6.98 

IO                      2. 

17 

2.96 

3  95 

5 

74 

742 

II                       I 

83 

2.80 

4.26 

5 

47 

8.02 

12                      I 

.02 

2-37 

370 

5 

39 

735 

13                 I 

54 

2.79 

4.14 

5 

52 

795 

14                 I 

45 

234 

368 

5 

37 

732 

15                 I 

.40 

259 

405 

5 

79 

8.32 

16                I 

58 

2.48 

385 

5 

36 

7.62 

»7                 I 

.48 

2.68 

4.07 

5 

90 

738 

18                 i 

.22 

258 

4.02 

5 

32 

7-32 

19                 I 

37 

2.23 

365 

5 

30 

732 

20                     I 

3i 

2.38 

377 

5 

33 

7.17 

21                      I 

14 

2-49 

358 

5 

39 

6.83 
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TABLE  XXII 

Accurate  of  Third  and  Fourth  Grades,  showing  average  performance  and 
variability  of  each  individual  for  the  twenty-eight  minutes 


otal            Average             A 

.D. 

C.T.ofA.D.'s. 

o 

o 

07 

13 

07 

13 

07 

13 

07 

13 

07 

13 

13 

2 

25 

2 

25 

2 

«5 

2 

25 

2 

.25 

.25 

3 

21 

34 

3 

21 

34 

3 

21 

34 

3 

21 

34 

3 

21 

34 

34 

29 

42 

29 

42 

29 

42 

29 

46 

*9 

46 

. 

,29 

46 

•44 

36 

73 

5 

36 

73 

5 

36 

.66 

S 

36 

.66 

5 

36 

.66 

5 

36 

.66 

. 

S 

36 

.66 

.68 

6 

43 

63 

6 

43 

57 

6 

43 

•57 

6 

43 

.63 

6 

•43 

•57 

6 

43 

50 

6 

43 

63 

6 

43 

57 

58 

7 

50 

64 

7 

.50 

.61 

7 

50 

.61 

6o 
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TABLE  XXII  (Continued) 


Votal           Av 

erage             A 

.D. 

C.T.cfA.D.'s 

.50 

54 

.50 

54 

50 

.61 

50 

.61 

50 

74 

50 

54 

.60 

8 

57 

60 

8 

57 

52 

8 

57 

67 

8 

57 

60 

8 

57 

60 

8 

57 

60 

.60 

9 

64 

57 

9 

.64 

73 

9 

64 

.64 

9 

64 

42 

9 

.64 

53 

9 

64 

53 

9 

64 

65 

9 

.64 

53 

.58 

10 

5* 

10 

.46 

10 

63 

10 

75 

10 

.82 

10 

75 

10 

75 

10 

68 

10 

72 

10 

.71       1 

.04 

10 

72 

10 

72 

10 

.81 

72 

II 

79 

67 

II 

79 

69 

II 

79 

97 

II 

79 

.81 

II 

79 

9i 

.81 

12 

86 

.48 

12 

,86 

74 

12 

.86 

34 

12 

.86 

63 

12 

86 

74 

12 

.86 

,61 
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TABLE  XXII  (Continued) 


Total            Average             A 

.D. 

C.  T.  of  A.  D.'s. 

12 

.86 

.52 

12 

.86 

52 

12 

.86        1 

■5* 

12 

.86 

73 

12 

.86 

73 

.69 

13 

93 

.80 

13 

93 

53 

13 

93 

.68 

13 

93 

.70 

13 

93 

.80 

13 

93 

70 

13 

93 

57 

13 

93 

.68 

13 

93 

5* 

13 

93       1 

05 

13 

93 

70 

70 

14       1. 

00 

44 

14       1. 

00 

73 

14       1. 

00 

29 

14       1. 

00 

73 

14       1. 

00 

58 

14       1. 

00 

87 

14       1. 

00 

44 

14       1. 

00 

73 

14       1. 

00 

86 

14       1. 

00 

58 

14       1. 

00 

57 

14       1. 

00 

71 

.63 

15       1. 

07 

92 

15       1. 

07 

63 

15       1 

07 

34 

15       1 

07 

53 

15       1 

07 

53 

15       1 

07 

.66 

15       1 

07 

73 

15       1 

07 

.66 

15       1 

°7 

63 

15       1 

°7 

63 

15       1 

07 

.80 

.64 

16       1 

14 

.62 

16       1 

14 

.64 

16       1 

14 

.60 

16       1 

14 

75 

65 

17       I 

.21 

56 

56 
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TABLE  XXII  (Continued) 


Total            Average             A 

.D. 

C.T.ofA.D.'s. 

18       i. 

29 

.81 

18       i. 

29 

61 

18       i. 

29 

72 

18       i 

29 

.64 

18       i 

29 

.61 

18       i 

29 

75 

18       i 

29 

94 

72 

19       1. 

36 

73 

19       1. 

36 

57 

19       1. 

36 

69 

19       1 

36 

98 

19       1 

36       1. 

11 

19       1 

36 

73 

19       1. 

36 

54 

19       1 

36 

•74 

19       1 

36 

.83 

19       1 

36 

.78 

77 

20       1 

43 

.64 

20       1 

43 

69 

20       1. 

43 

72 

20       1. 

43 

77 

20       1. 

43 

63 

20       1. 

43 

.63 

20       1. 

43 

72 

20       1 

43 

63 

.68 

21       1 

50 

86 

21       1. 

50 

71 

21       1 

50 

57 

21       1 

50 

50 

21       1 

50       1 

00 

21       1. 

50 

78 

21       1. 

50 

64 

.72 

22       1. 

57 

55 

22       1. 

57 

55 

22       1 

57 

83 

22       1 

57 

57 

22       1 

57 

9i 

22       1 

57 

•57 

• 

22       1 

57 

97 

70 

23       1 

64 

.82 

23       1 

64 

69 

23       1 

64       1. 

21 

23       1 

64 

59 

23       1 

.64 

44 
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Total            Average 

A.D. 

C.T.ofA.D.'s. 

23       1 

.64 

82 

23       1 

.64 

1.08 

.80 

24       1 

71 

75 

24       1 

•71 

75 

24       1 

71 

•  75 

24       1 

•  71 

75 

24       1 

71 

1.02 

24       1 

71 

72 

24       1 

71 

65 

24       1 

71 

•  55 

24       1 

.71 

.89 

24       1 

71 

1.02 

24       1 

.71 

•75 

24       1 

71 

.90 

79 

25       1 

79 

1.09 

25       1 

•79 

72 

25       1 

79 

1.07 

25       1 

79 

1.09 

25       1 

•79 

1.50 

25       x 

79 

•72 

25       1 

79 

72 

25       1 

79 

93 

25       1 

•79 

44 

.92 

26       1 

.86 

87 

26       1 

.86 

63 

26       1 

.86 

.87 

26       1 

.86 

•  89 

26       1 

.86 

1.28 

1 

26       1 

.86 

•  87 

26       1 

.86 

.87 

26       1 

.86 

1. 00 

91 

27       1 

93 

.66 

27       1 

93 

93 

27       1 

93 

.66 

27       1 

93 

95 

27       1 

•93 

.66 

77 

28       2 

.00 

.84 

28       2 

.00 

58 

28       2 

.00 

.70 

28       2 

.00 

.70 

28       2 

.00 

.70 

28       2 

.00 

I.06 

28       2 

.00 

.70 

29       2 

.07 

•93 
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TABLE  XXII  (Continued) 

Total 

29 
29 

29 
29 

30 
30 
30 
30 
30 
30 
3i 
3i 
3i 
3i 
3i 
3i 
32 
32 
32 
32 
32 
32 
33 
33 
33 
33 
33 
33 
33 
33 
33 
33 
33 
33 
34 
34 
34 
34 
35 
35 
35 
35 
35 
35 


Average 

A.D. 

C.T.ofA.D.'s 

2.07 

.66 

2.07 

1.08 

2.07 

79 

2.07 

.66 

.82 

2.14 

.86 

2.14 

.62 

2.14 

98 

2.14 

.86 

2.14 

.62 

2.14 

.86 

.80 

2.21 

.80 

2.21 

73 

2.21 

.84 

2.21 

1.04 

2.21 

•95 

2.21 

49 

.81 

2.28 

1.03 

2.28 

59 

2.28 

•93 

2.28 

.50 

2.28 

•75 

2.28 

1.23 

.84 

2.36 

1. 16 

2.36 

78 

2.36 

.68 

2.36 

.78 

2.36 

83 

2.36 

.68 

2.36 

78 

2.36 

.83 

2.36 

.68 

2.36 

.87 

2.36 

•78 

2.36 

.68 

.80 

2.43 

1.04 

2.43 

.85 

2-43 

.78 

243 

.90 

.89 

2.50 

93 

2.50 

.85 

2.50 

1. 13 

2.50 

.63 

2.50 

1. 00 

2.50 

I.05 

94 
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TABLE  XXII  (Continued) 


Total 

36 
36 
36 
36 
36 
37 
37 
37 
37 
37 
37 
37 
37 
38 
38 
38 
38 
38 
39 
39 
39 
39 
39 
40 
40 
40 
40 

41 

41 

41 

41 

41 

42 

42 

42 

42 

42 

42 

42 

42 

43 

43 

43 

43 


Average 

A.D. 

C.T.ofA.D.'s. 

2.58 

70 

2.58 

.90 

2.58 

1. 19 

2.58 

1.29 

2.58 

.70 

95 

2.64 

1.24 

2.64 

1.06 

2.64 

1. 16 

2.64 

69 

2.64 

98 

2.64 

1. 00 

2.64 

.82 

.96 

2.64 

69 

2.71 

76 

2.71 

1-43 

2.71 

1. 17 

2.71 

95 

2.71 

79 

1.02 

279 

70 

2.79 

73 

2.79 

84 

2.79 

.81 

2.79 

1.26 

.87 

2.86 

.60 

2.86 

.92 

2.86 

74 

2.86 

78 

.76 

2.93 

.82 

293 

.64 

2.93 

94 

293 

1.20 

293 

94 

91 

3.00 

1.20 

300 

•94 

3.00 

57 

300 

.66 

300 

54 

3.00 

.66 

300 

.81 

3.00 

1.08 

73 

307 

1. 14 

307 

.92 

307 

77 

3.07 

.80 
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TABLE  XXII 

(Coniinu 

«0 

Total 

Average 

A.D. 

C.T.qfA.D.'s 

43 

307 

52 

43 

3 

07 

•37 

75 

44 

3 

14 

.66 

44 

3 

14 

1. 16 

44 

3 

14 

1. 16 

99 

45 

3 

.21 

.83 

45 

3 

.21 

1.06 

45 

3 

.21 

93 

45 

3- 

21 

1.09 

98 

46 

3 

.28 

.98 

46 

3 

.28 

79 

46 

3 

.28 

.89 

46 

3 

.28 

.98 

46 

3 

.28 

.89 

•91 

47 

3 

36 

.91 

47 

3 

36 

74 

47 

3 

36 

.81 

47 

3 

36 

1. 01 

47 

3 

36 

•91 

47 

3 

36 

67 

.84 

48 

3 

43 

1.20 

48 

3 

43 

93 

48 

3 

43 

•99 

48 

3 

43 

1. 13 

48 

3 

43 

99 

48 

3 

43 

1. 13 

48 

3 

43 

99 

1.05 

49 

3 

50 

63 

49 

3 

50 

.84 

49 

3 

50 

77 

49 

3 

50 

.84 

•  77 

50 

3 

57 

.71 

71 

51 

3 

64 

.76 

51 

3 

64 

.61 

51 

3 

64 

.80 

72 

52 

3 

71 

1.04 

52 

3 

71 

•74 

.89 

54 

3 

86 

1. 00 

54 

3 

86 

1. 15 

54 

3 

86 

73 

.96 

55 

3 

93 

1.06 

55 

3 

93 

79 

55 

3 

93 

•94 

55 

3 

93 

94 

94 
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TABLE  XXII  (Continued) 

Total 

Average 

4.0. 

C.T.ofA.D.'s 

56 

4.00 

.56 

.56 

57 

4 

.07 

77 

57 

4 

07 

77 

77 

58 

4 

.14 

•75 

58 

4 

14 

1. 41 

58 

4 

.14 

1. 16 

1. n 

59 

4 

.21 

93 

59 

4 

.21 

1. 18 

1.06 

60 

4 

.28 

•47 

60 

4 

.28 

.68 

•57 

61 

4 

36 

1.09 

1.09 

62 

4 

43 

1. 51 

62 

4 

43 

1.02 

1.26 

64 

4 

57 

96 

64 

4 

57 

96 

.96 

65 

4 

64 

74 

•74 

66 

4 

71 

1.04 

1.04 

68 

4 

86 

.87 

.87 

70 

5 

00 

.70 

.70 

71 

5- 

07 

.66 

.66 

72 

5. 

14 

.87 

.87 

73 

5 

21 

.83 

.83 

76 

5 

43 

1.03 

1.03 

85 

6. 

07 

1. 21 

1. 21 

no 

7 

85 

1.02 

1.02 

TABLE  XXIII 

Showing  the  Data  for  Third  and  Fourth  Grades,  Accurates  with 

C.  T.'s  and  Average  A.  D.'s  Combined  into  Twelve  Groups 

Average 


C.T.                               A 

.D. 

.07  to  .43 

40 

.50  to  .86 

67 

.93  to  1.29 

65 

1.36  to  1. 71 

75 

1.79  to  2.14 

13 

2.21  to  2.58 

87 

2.67  to  3.00 

.88 

3.07  to  3.43 

.92 

3.50  to  3.86 

.81 

3.93  to  4.28 

.84 

4.36  to  5.21 

90 

5.43  to  7.85           1 

09 

The  twelve  groups  given  here  were  obtained  by  combining  the  data  of  Table 
XXII  so  that  as  nearly  as  possible  the  twelve  groups  would  proceed  by  steps  of  .36. 
The  data  would  not  submit  to  this  treatment  in  the  last  two  groups  of  the  twelve. 
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TABLE  XXIV 

Attempts,  Third  and  Fourth  Grades,  Showing  Average  Performance 

and  Average  Variability  of  Certain  Groups  of  Individuals  for 

the  Twenty-eight  Minutes.    Eighty-five  Groups 


Number  of  Columns 

Number  of  Columns 

Number  of  Columns 

C.  T.          Average 

C.  T.           Average 

C.  T.            Average 

ofA.D. 

ofA.D. 

ofA.D. 

.28 

55 

2.36 

62 

4.07 

49 

43 

49 

243 

52 

4.14 

81 

.64 

55 

2.50 

67 

4.21 

60 

.78 

34 

2.57 

53 

4.28 

70 

.86 

24 

2.64 

4i 

435 

79 

1. 00 

10 

2.71 

67 

443 

67 

1.07 

13 

2.78 

54 

4  50 

68 

1. 14 

29 

2.86 

59 

457 

62 

1. 21 

46 

293 

41 

4.64 

71 

1.28 

4i 

300 

42 

4.71 

89 

1-35 

60 

307 

68 

4.78              I. 

18 

1  43 

56 

3- H 

53 

485 

55 

150 

58 

321 

49 

493 

42 

1.57 

•  57 

328 

67 

500 

33 

I.64 

47 

335 

•55 

507 

95 

1. 71 

58 

3  43 

66 

5.14              1 

08 

1.78 

54 

350 

.66 

521 

42 

183 

47 

357 

.64 

528 

60 

1-93 

37 

3  64 

56 

5-36 

62 

2.00 

.46 

371 

.71 

543 

65 

2.07 

37 

378 

.60 

5  50 

64 

2.21 

55 

3  92 

49 

5.64 

53 

2.28 

56 

4.00 

23 

578 

5-85 

593 
6.00 

6.07 

6.28 

6-43 

6.50             2 

6.93 
7.00 

7  43 
8.71 

9  79                < 
1364                < 

58 

51 

82 

57 
67 

79 
72 

14 
53 

■43 

.92 

78 

J.2I 
*   72 
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TABLE  XXV 

'  the  Foregoing 

Table  Combined  inU 

Average 

C.T. 

of  A.  D. 

.28  to    1. 71 

.46 

1.78  to   2.14 

45 

2.25  to   2.57 

58 

2.64  to   3.00 

.51 

3.07  to   3.43 

•59 

350to   3.86 

63 

3.92  to   4.28 

55 

4.35  to   4.71 

73 

4.78  to    5.28 

.69 

536  to   5.70 

.67 

5.78  to   6.93 

.81 

7.00  to  13.64 

2.41 

la  this  table  we  proceed  as  nearly  by  steps  of  .36  as  possible.  The  first  group 
I'd  bit  four  groups  could  not  well  be  made  to  fulfill  this  condition.  But  as  this 
doet  not  affect  the  mathematical  significance  of  the  results,  it  matters  little. 


TABLE  XXVI 

Accuracy,  Seventh  and  Eighth  Grades,  Showing  Average  Performance 

and  Average  Variability  of  Certain  Groups  of  Individuals  for 

the  Forty-two  Minutes  of  Working.    There  are  122  Groups 


Number  of  Columns 


Number  of  Columns 


Number  of  Columns 


C.T. 

Average 

C.T. 

Average 

C.T. 

Average 

ofA.D. 

ofA.D. 

ofA.D. 

•43 

53 

2.38 

1. 10 

357 

1.05 

48 

59 

2-43 

1. 21 

362 

1. 00 

.62 

65 

2.48 

1.07 

367 

90 

.71 

.82 

2.52 

83 

371 

1.24 

.76 

•  5* 

a. 57 

1.30 

376 

1.08 

90 

.61 

2.62 

1. 01 

381 

1. 15 

1.04 

93 

2.67 

1.04 

386 

1.23 

1.29 

9* 

2.71 

99 

3  90 

65 

»  33 

5i 

2.76 

.82 

3  95 

1. 11 

1.38 

89 

2.81 

1.05 

4.00 

1. 19 

'•43 

1 

37 

2.86 

.84 

405 

1. 00 

1.62 

99 

2.90 

.90 

4.10 

1.09 

1. 81 

77 

a. 95 

.60 

4.14 

1.09 

1.86 

1. 

62 

3.00 

.76 

4.19 

.98 

1.90 

1. 

03 

3  05 

1. 00 

4.24 

1.27 

195 

73 

3  09 

97 
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TABLE  XXVI  (Continued) 


Number  of  Columns 

Number 

of  Columns 

Number  of  Columns 

C.T. 

Average 

C.T. 

Average 

C.  T.            Average 

ofA.D. 

ofA.D. 

of  A 

L  D. 

3.14 

1.02 

4.29                1 

38 

2  .OO 

.48 

3.19 

•71 

438                1 

07 

2.05 

.78 

324 

97 

4-43                1 

.12 

2.09 

92 

3  29 

1.04 

4.48 

90 

2.14 

.89 

3  33 

.83 

452                1 

21 

2.19 

95 

338 

1. 11 

4-57                1 

08 

2.24 

.83 

343 

1.09 

4.62                1. 

15 

2.29 

1. 15 

348 

.89 

4.67                1. 

.11 

2.33 

1. 01 

3  52 

1. 21 

4.71                1 

49 

4.76 

1. 16 

533 

1.02 

6.09                1. 

03 

4.8I 

1. 11 

543 

1. 81 

6.14                1. 

39 

4.86 

1.84 

548 

1.26 

6.19 

99 

4.90 

1. 61 

552 

1.46 

6.28                1. 

08 

495 

97 

557 

1.54 

6-43                1 

30 

5.00 

.67 

562 

1. 10 

6.48                1. 

22 

5.05 

1.24 

571 

1. 01 

6.57 

95 

5  09 

1. 14 

5  76 

1. 14 

6.62                1. 

14 

5.14 

1. 14 

586 

.86 

6.76                1. 

32 

519 

1. 16 

590 

.87 

6.90                1. 

28 

524 

1.34 

595 

.46 

6.95                1 

17 

5  29 

.98 

6.00 

.86 

7.05 

714                1 
7.19                1. 

748                1. 

757                1 
7.67                1. 

771                1 
7.80               1. 

8.00               1 

8.14               1, 

852 

8.71                1 

9  33                1 
11.52                1 

78 

44 
38 

41 
31 
85 
35 
35 
33 
04 
98 
59 
49 
65 
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Average 

C.  T. 

ofA.D. 

43  to 

1.90 

85 

1.95  to 

2.38 

.88 

2.43  to 

2.86 

1.02 

2.90  to 

3  33 

.88 

3  38  to 

3.8i 

1.07 

3.86  to 

4.29 

1. 10 

4  38  to 

4.76 

1. 14 

4.81  to 

5.24 

1. 15 

529  to 

5  7i 

1.28 

5  76  to 

6.19 

95 

6.28  to 

6.62 

1. 14 

6.76  to 

1152 

1-34 

The  data  of  Table  XXVI  could  not  be  easily  handled  in  a  graphic  representa- 
tion, consequently  it  was  combined  into  twelve  groups  as  in  Table  XXIII.  In 
this  particular  table  we  proceed  as  nearly  by  steps  of  .43  of  a  column  as  possible. 
The  first  and  last  groups  of  the  series  could  not  be  well  made  to  go  by  the  step. 


TABLE  XXVIII 

Showing  Central  Tendencies  and  Corresponding  Average  A.D.  of 

Columns  Attempted  by  Groups  of  Individuals  of  Seventh  and 

Eighth  Grades.     There  are  127  Groups 


Number 

of  Columns 

Number 

of  Columns 

Number 

of  Columns 

C.  T. 

Average 

C.T. 

Average 

C.  T. 

Average 

of  A.D. 

of  A.D. 

of  A.  D. 

2.14 

70 

5  29 

65 

8.00 

2.22 

2. 

43 

.68 

5 

33 

62 

8.05 

1   13 

2. 

76 

58 

5 

38 

94 

8.09 

79 

2 

81 

.61 

5 

43 

79 

8.14 

•4i 

2 

90 

.61 

5 

48 

1 

04 

8.24 

67 

2 

95 

1. 17 

5 

52 

77 

8.62 

1. 13 

3 

00 

.29 

5 

57 

82 

8.71 

74 

3 

05 

•54 

5 

62 

73 

8.81 

•92 

3 

09 

53 

5 

67 

.65 

8.86 

1. 12 

3 

19 

1. 15 

5 

7i 

92 

9.09 

.88 

3 

24 

67 

5 

76 

1 

05 

9.29 

.64 

3 

29 

.62 

5 

81 

57 

9  33 

1.27 

3 

33 

•5i 

5 

86 

.81 

938 

93 

3 

38 

-69 

5 

90 

79 

9  52 

1.02 

3 

43 

53 

5 

93 

.66 

9  57 

.88 

.««»»• FkT,ouE  ?^u»  ic--*  .--"■si 

^0fCol^nS  C.T-  ojA-P*  9.67  .84 

W*  J     A«erag«  72  9  7i  f  03 

T*  ojA.p'  6.00  .83  l0M  .89 

.69  6.o5  .64  l057  9* 

j.52  .79  6.09  .75  l0.6*  .99 

3.57  .64  6U  .72  l0.7l  M 

3.67  .9°  6.19  !.14  l076  ** 

3.7*  1.  «o  6.24  .9*  ii.»9  1.29 

3-76  .62  6.29  XM  11.43  2-77 

3.81  .88  6-33  .81  H.62  5. n 

3.9°  i.U  6.3*  .83  11.86  x.6 

3.95  .76  6. 43  .83  X3-09 

4.00  .76  652  .69 

4.05  .67  6.57  .95 

4.09  .92  6-62  .70 

4.14  .65  6.67  .72 

4.19  .65  67*  .65 

4.24  .72  676  .61 

4.29  .68  6. ^  .63 

4.33  .72  6.9°  .7* 

4.3*  .20  695  .89 

4.43  .5l  7-°5  98 

4-48  1.1°  7.09  .3° 

4.52  .59  7.U  .61 

4.57  .69  7.19  .56 

4.62  .74  7.24  .92 

4.67  .57  7.29  .96 

4.7*  .55  7.33  .64 

4-76  .99  7-38  .9° 

4.8I  .68  7.43  t69 

4.S6  .45  7.4*  .7* 

4.9°  .7*  7.52  .68 

4.95  .38  7.57  .87 

5.00  .70  7.62  .97 

5.05  .68  7.71  .88 

5.09  .74  7.76  .83 

519  l*6  *■*  '88.,   Hand\eA 
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TABLE  XXIX 

of  Foregoing  Table, 

Combined  into  T 

Average  of 

C.T. 

A.D. 

2.14  to 

2.90 

.64 

2.95  to 

405 

75 

4.09  to 

4.76 

.66 

4.81  to 

548 

76 

5.48  to 

6.19 

•77 

6.24  to 

6.90 

.82 

6.95  to 

7.62 

.81 

7.71  to 

8.24 

98 

8.62  to 

8.81 

93 

8.86  to 

971 

94 

10.24  to  10.76 

•94 

11. 19  to 

13  09 

2.34 

The  actual  facts  for  the  present  test  are  seen  on  comparing  the 
average  variability  with  the  absolute  measure  of  performance.  (See 
the  accompanying  tables — XXII-XXVIII — which  give,  for  the  indi- 
viduals having  the  same  central  tendency,  the  average  of  their 
A.  D.'g.)  Each  of  these  tables  is  followed  by  a  regrouping  which 
Wngs  out  more  fully  the  tendency  of  the  A.  D.'s  to  increase  with 
4e  C.T. 

In  the  absence  of  any  universally  accepted  law,  we  can  take  these 
figures  (Tables  XXII,  XXIV,  XXVI,  XXVIII)  as  our  basis  and 

**what  law  of  dependence  would  fit  them  best.    We  have  assumed 

Var. 
^t  this  law  would  have  the  form  r     'x  =  C.  and  find  what  value 

°f  the  unknown  n  will  give  best  agreement  with  this  law.  That  is, 
^  are  to  find  such  a  root  of  the  C.  T.  as  will  give  the  most  constant 
Quotient  when  divided  into  the  corresponding  variability. 

Thus  two  methods  were  used  for  determining  what  value  of  n 
&ve  the  closest  approximation  to  a  constant  ratio: 

1.  Find  for  what  value  of  n  the  variability  of  the  quotient  is  least. 

2.  Observe  for  what  value  of  n  the  curve  approaches  most  closely  to  the 
horuontal  line. 
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Tables  XXX,  XXXI,  XXXII,  XXXIII  give  the  Average,  Aver- 


x  . 


age  Deviation,  and  Probable  Error  for  each  value  of  -r  in  attempts 

yl 

and  accurate  performance. 


TABLE  XXX 

Showing  for  Accurate*  of  Third  and  Fourth  Grades  the  Central  Tendency  and 

x 
Average  Deviation  of  Different  Values  of—?,  where  x=A.D.,y=C.T. 


Values  of  - 

y 


Values  of 


Values  of  -» 


Values  of 
Values  of 
Values  of 
Values  of 


x 
~r 

x 

t"7i 


3." 


y* 


Values  of  -r 
J* 

Values  of  -j 

Values  of  -r 
y\ 

Values  of  — r 

yio 

Values  of  x 


Average 

.489 

A.D. 

.302 

P.E. 

*5* 

Average 

549 

A.D. 

.1227 

P.E. 

.104 

Average 

559 

A.D. 

.119 

P.E. 

.100 

Average 

569 

A.  D. 

.1065 

P.E. 

.090 

Average 

577 

A.  D. 

.1011 

P.E. 

085 

Average 

593 

A.D. 

.10069 

P.E. 

084 

Average 

.613 

A.D. 

.088 

P.E. 

075 

Average 

.646 

A.  D. 

.090 

P.E. 

076 

Average 

.691 

A.  D. 

.096 

P.E. 

.081 

Average 

.7089 

A.D. 

.108 

P.E. 

091 

Average 

7283 

A.  D. 

.111 

P.E. 

094 

Average 

793 

A.  D. 

.150 

P.E. 

.127 
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TABLE  XXXI 

Showing  for  Attempts  of  Third  and  Fourth  Grades  ike  Central  Tendency 

x 
and  Average  Deviation  of  Different  Values  of  -? 


Valuesof  - 

y 

Average 

.241 

A.D. 

.130 

P.E. 

.012 

Valuesof  ^ 

y* 

Average 

376 

A.D. 

.126 

P.E. 

.011 

Valuesof  4 

y* 

Average 

453 

AD. 

.130 

P.E. 

.011 

Valuesof  ~ 
y* 

Average 

.501 

AD. 

.167 

P.E. 

.016 

Valuesof  -, 
y* 

Average 

.560 

A.D. 

.192 

P.E. 

.016 

Valuesof  4 
y* 

Average 

596 

AD. 

.212 

P.E. 

.019 

Valuesof  — 

7>e 

Average 

.615 

AD. 

.225 

P.E. 

.017 

Valuesof  x 

Average 

.700 

AD. 

.290 

P.E. 

.026 

TABLE  XXXII 

Showing  for  Accurates  of  Seventh  and  Eighth  Grades  the  Central  Tendency 
and  Average  Deviation  of  Different  Values  of  — 

P.E.       .011 


P.  E.  .009 

P.E.  .008 

P.E.  .091 

P.E.  .054 


Valuesof  - 

y 

Average 

329 

AD. 

1431 

Values  of  ^ 

y* 

Average 

558 

AD. 

"33 

Woes  of  ^ 

Average 

.684 

AD. 

1057 

Valuesof  ^ 

y* 

Average 

.766 

AD. 

.1196 

Valuesof  x 

Average 

1.069 

A.  D. 

.2079 
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TABLE  XXXIII 

Showing  for  Attempts  of  Seventh  and  Eighth  Grades  the  Central  Tendency 

x 
and  Average  Deviation  of  Different  Values  of  — i 

Values  of  - 

y 

Values  of  -7 

Values  of  -» 

Values  of  -r 

Values  of  x 


Average 

.148 

AD. 

.048 

P.E. 

.004 

Average 

346 

AD. 

.085 

P.E. 

.006 

Average 

.467 

AD. 

.107 

P.E. 

.006 

Average 

•542 

AD. 

.116 

P.E. 

.009 

Average 

.86 

AD. 

304 

P.E. 

.0228 

Explanation 

Tables  XXXIV,  XXXV,  XXXVI,  and  XXXVII  give  the  different  values  of 

x 

-?  combined  into  twelve  groups.    (See  Figures  13,  14,  15,  and  16.) 

y* 

x 

Figures  13  to  16  show  graphically  the  position  of  each  value  of  —  on  a  vertical 

y* 

scale  for  increasing  total  performance  on  a  horizontal  scale. 
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x 
Accuracy,  Third  and  Fourth  Grades  t  Values  -r 
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.40 
.67 
.65 
•75 
83 
.87 
.88 
.92 
.81 

.84 

.90 

1.09 


y 

1.67 

99 

59 

.48 

42 
36 

31 
.28 

.21 

.20 

19 
.16 


X 

"T 


y» 


s.s 


*7» 


.82 

79 

74 

69 

.82 

85 

.80 

.81 

.62 

.62 

.62 

63 

.60 

.60 

.62 

63 

.59 

59 

61 

62 

.55 

.56 

59 

.60 

.51 

52 

55 

56 

.49 

5i 

53 

55 

•34 

4* 

45 

46 

.40 

41 

44 

46 

.40 

4i 

44 

46 

.41 

43 

47 

49 

«.» 

72 

78 

61 

64 
64 

62 
60 

57 
49 
48 
48 
5* 
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TABLE  XXXIV  (Continued) 


Total 

i  to  6 

7  to  12 

13  to  18 

19  to  24 

25  to  30 

31  to  36 

37  to  42 

43  to  48 

49  to  54 

55  to  60 

61  to  73 

76  to  1 10 


Average 

x 

y* 
62 
76 
63 
65 

66 

65 
62 

62 

53 
51 
54 

59 


Average 


y* 
67 

74 
64 

67 
70 
70 
66 

69 

59 

59 
61 

69 


Average 

x 

y* 

50 

71 

64 

70 

74 
76 

74 
75 
64 
66 

69 
79 


Average 

x 

yi 

47 
70 
64 
71 
75 
78 

77 
79 
69 
65 
74 

86 


Average 

x 

Wo 
46 
69 
64 
72 

78 
80 

79 
81 

71 
72 

77 
90 


TABLE  XXXV 
Attempts,  Third  and  Fourth  Grades,  Values 


Total             Aver-     Aver-     Aver-     Aver-     Aver-     Aver-     Aver-     Aver 

Number  of 

agfi 

age        i 

He 

age 

age 

age 

age        1 

age 

Columns 

X 

X 

X 

X 

X 

X 

X 

X 

y 

y* 

y* 

y* 

y* 

y* 

Yh 

4  to  24 

.46 

54 

.48 

46 

.46 

.46 

.46 

.46 

25  to  30 

45 

.28 

32 

.38 

38 

.40 

4i 

42 

31  to  36 

.5* 

36 

43 

46 

49 

49 

49 

53 

37  to  42 

.51 

.18 

30 

35 

39 

42 

45 

46 

43  to  48 

59 

18 

33 

36 

41 

48 

5i 

53 

49  to  54 

.63 

17 

32 

41 

45 

49 

54 

55 

55  to  60 

55 

13 

27 

35 

39 

44 

.48 

48 

61  to  66 

73 

17 

32 

.46 

49 

56 

60 

63 

67  to  74 

69 

.14 

.31 

40 

.46 

52 

57 

59 

75  to  80 

67 

.12 

.28 

39 

44 

.50 

54 

57 

81  to  97 

.81 

13 

32 

44 

51 

60 

62 

57 

98  to  191          2 

41 

23 

54       1 

.11     1 

34     1 

63     1. 

78       1. 
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TABLE  XXXVI 

x 
Accuracy,  Seventh  and  Eighth  Grades,  Values  of  -r 


Total 

Average 

Average       Average 

Average 

Average 

Columns 

X 

X 

X 

X 

X 

y 

yi 

yi 

yi 

9-40 

85 

.81 

.80 

.82 

.83 

41-50 

.88 

.41 

60 

67 

75 

51-60 

1.02 

39 

63 

74 

80 

61-70 

.88 

.21 

52 

60 

64 

71-80 

1.07 

30 

58 

68 

79 

81-90 

1. 10 

.27 

54 

69 

77 

91-100 

1. 14 

25 

53 

69 

7* 

IOI-IIO 

1. 15 

23 

52 

67 

77 

111-120 

1.28 

23 

55 

73 

.86 

121-130 

95 

17 

35 

52 

61 

131-140 

1. 14 

.18 

45 

61 

71 

141-242 

1-34 

17 

.48 

67 

.80 

TABLE  XXXVII 

x 
Attempts,  Seventh  and  Eighth  Grades,  Values  of  -? 


Total           Average 

Average 

Average 

Average 

Average 

Columns 
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X 

X 

X 

X 

y 

yi 

yi 

yi 

45-6i 

64 
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397 

.464 

502 

62-85 

75 

.215 

403 

495 

542 

86-100 

66 

153 

.296 

405 

458 

101-115 

76 

.148 

335 

.429 

507 

111-130 

77 

.131 

.316 

424 

524 

I3I-H5 

82 

.126 

329 

.441 

515 

146-160 

84 

143 

.301 

415 

495 

162-173 

98 

.122 

346 

.488 

58i 

181-185 

93 

.107 

315 

•452 

507 

186-214 

94 

.101 

.312 

451 

542 

215-221 

94 

.089 

.289 

•437 

527 

226-275          2 

34 

.196 

.672 

1. on 

I. 

254 

A* 

A' 
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POTAU  COLUMNS 

Corrected  Variability  in  Attempts 

13  and  14  give  the  graphical  representation  for  the 
attempts  data  of  corrected  variability  for  the  younger  and  older 
groups  respectively. 
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For  the  Third  and  Fourth  grades  attempts,  Figure  13  shows  the 
-j,  —r  and  -7  lines  to  be  nearly  horizontal,  but  the  preference  goes 

to  the  — 1  value  as  it  is  the  most  nearly  horizontal  line  of  those  lines 


v 


u 

1 

n 

s 

•? 

j 


U     fft  i*r*/*S  -J*t*9*4 . £#-#**     l^r  ^* /*e 


"TTS — 7^1  tf-f!    y^^ii-J1  Wl    JW-  *W   *f5*   JJ-W  yM    y^OJ 

Total  Columns  ~ 

and  besides  the  —x  series  has  the  smallest  average  deviation  of  all 
the  different  series  of  the  — r  values. 

yk 

As  to  the  attempts  data  of  corrected  variability  for  the  Seventh 
and  Eighth  grades,  the  -  values  and  the  -7  values  compete  most 
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strongly  for  the  preference.  We  have  chosen  here,  however,  the 
-  line,  since  it  appears  to  be  the  most  nearly  horizontal  one  and  the 
judgment  seems  justified  by  the  fact  that  the  average  deviation  of 
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the  -  series  is  smaller  than  that  of  the  other  series.    But  the  experi- 

y 

menter  thinks  that  the  cause  of  this  inconsistency  is  due  to  the 
fact  that  some  of  the  subjects  at  the  last  attempted  too  recklessly 
and  thus  impaired  the  data  to  a  small  extent.  If  this  had  not  hap- 
pened the  y*  value  would  have  been,  the  writer  believes,  the  chosen 
value  of  y*.     (Figure  14.) 


7<  «W/*      v      /THviffr  ... 
4       J?t<+*sf*S  —, 


>f'7 


Figure  17  gives  the  different  positions  on  a  vertical  scale  for  the  A.  D.  of  each 

x 

-7  acnes  for  both  groups  in  both  attempts  and  accurates.    In  the  case  of  the 

Third  and  Fourth  grades,  in  attempts,  the  curve  drops  lowest  for  the  — r  series; 

x  y 

but  in  accurates  it  is  lowest  in  the  — 1  series  of  values.    In  the  case  of  the  Seventh 

y  x 

and  Eighth  grades,  in  attempts,  the  curve  is  lowest  in  the  -  series;  but  in  the 

x  y 

accurates  it  goes  lowest  in  — j  as  it  did  in  the  accurates  for  the  younger  children. 
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Variability  and  Performance 

„r  ,        r  1       •  V*1''  „  Var' 

Now,  if  we  accept  the  formula  in  one  case  TT7f\  =  C,  or  ~przr\  =  C, 

as  fitting  the  general  run  of  our  facts,  having  based  our  correction 
upon  the  general  run  of  our  own  data,  of  course  we  cannot  find 
whether  those  who  do  less  or  do  more  are  more  variable  since  what 
we  have  done  shows  them  equally  variable. 

But  we  can  from  this  graph  of  the  accepted  law  of  dependencies 
see  if  there  are  any  eccentricities  not  according  to  the  normal.  We 
may  say  that  the  group  has  variability  in  excess  of  the  general  run 
of  the  data,  or  that  it  is  close  to  the  general  run  of  the  data. 

In  all  the  graphs  illustrating  the  accepted  law  of  dependencies 
we  find  the  last  one  or  two  ratios  departing,  or  so  tending,  from 
the  norm  and  likewise  the  first  one  or  two. 

In  the  case  of  the  accurate  performances  for  the  younger  group, 

this  departure  from  the  norm  is  only  slight  (see  Figure  15 — y*  line). 

With  the  older  group  the  departure  at  beginning  and  end  is  a  little 

more  pronounced  (Figure  16).    But  in  the  case  of  the  attempts  data 

the  departure  is  quite  pronounced,  especially  at  the  end  of  the 

x  x 

~l  and  -  lines,  for  both  groups.    We  may  then  say  that  this  shows 

a  tendency  for  the  subjects  who  attempt  most,  and  also  for  those 
who  attempt  least,  to  exceed  the  normal  variability  to  some  extent. 
This  surplus  of  variability  in  the  slowest  and  quickest  workers  is 
probably  due  to  the  fact  that  they  show,  more  than  the  medium 
workers,  a  progressive  change  throughout  the  course  of  the  work, 
the  quickest  workers  increasing  their  speed  as  the  work  proceeds, 

• 

and  the  slowest  workers  gradually  slackening  (See  pp.  49-54). 
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A  PSYCHOLOGICAL  STUDY  OF  TRADE-MARK 

INFRINGEMENT 


INTRODUCTION 

1.  Aim  op  the  Study 

This  study  is  concerned  with  the  application  of  psychology  to 
an  important  division  of  law,  the  infringement  of  trade-marks, — 
and  its  chief  purpose  is  to  help  the  courts  and  the  Patent  Office 
to  decide  more  accurately  the  questions  of  trade-mark  infringement 
and  unfair  competition.    Our  experiments  have  led  us  to  the  dis- 
covery of  serious  theoretical  and  practical  objections  to  the  present 
judicial  procedure.    Under  the  judicial  procedure  it  is  practically 
impossible  to  judge  questions  of  infringement  or  non-infringement 
of  similar  trade-marks  consistently.    Psychology  can  place  at  the 
disposal  of  the  courts  established  facts,  bearing  on  questions  of  con- 
fusion, such  as  have  never  been  arrived  at  before  in  any  reported 
ease.    Straightforward     psychological     methods     can     determine 
whether  the  mark  complained  of  does  actually  cause  confusion,  what 
the  exact  amount  of  the  confusion  is,  and  how  it  compares  with  the 
eitent  of  confusion  between   other  litigated   trade-marks.     The 
present  study  proceeds  from  the  conviction  that  in  giving  definite 
answers  to  these  questions  psychology  can  be  of  material  assistance 
to  the  courts. 

2.  Various  Phases  of  the  Subject  of  Trade-Marks 

The  subject  of  trade-marks  is  indeed  a  broad  and  complicated  one. 
Names,  words,  marks,  emblems,  designs,  symbols,  or  devices,  alone 
o*  in  combinations,  are  used  as  trade-marks.    We  have  restricted 
our  investigation  to  trade-mark  names  and  words.    The  whole  sub* 
ject  may  be  viewed  from  at  least  six  different  angles,  *.  e.,  (a)  the 
history  and  development  of  the  use  of  trade-marks,  (6)  the  psy- 
chological selection  of  trade-marks,   (c)  the  economics  of  trade- 
marks, (d)   trade-mark  laws  and  decisions,  (e)  the  ethics  of  in- 
fringement, and  (/)  the  psychology  of  trade-mark  infringement 
The  present  discussion  is  primarily  concerned  both  with  the  pay* 
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but  also  the  trade-marks.  While  the  trade-mark  is  but  a  means  of 
selling  the  article  it  often  represents  the  owner's  greatest  asset,  the 
cumulative  good  will  or  reputation  of  his  business. 

(d)  Trade-mark  Laws  and  Decisions. — These  are  measures  for 
the  protection  of  the  consuming  public  and  of  the  owner  of  the 
trade-mark.  In  recent  years  the  expansion  of  business  has  made 
the  field  of  trade-mark  law  increasingly  extensive  and  complicated. 
What  constitutes  an  illegally  deceptive  or  infringing  trade-mark  is 
defined  in  the  United  States  Trade-Mark  Law  of  February  20,  1905, 
as  follows:  "Trade-marks  which  are  identical  ...  or  which  so 
nearly  resemble  a  registered  or  known  trade-mark  ...  as  to  be 
likely  to  cause  confusion  or  mistake  in  the  mind  of  the  public,  or 
to  deceive  purchasers  shall  not  be  registered  .  .  .  "  (Sec.  5,  b).  In 
section  16  of  this  act  there  is  another  statement  concerning  unlaw- 
ful simulation  of  trade-marks.  It  says:  "Any  person  who  shall, 
.  .  .  reproduce,  counterfeit,  copy,  or  colorably  imitate  any  such 
trade-mark  .  .  .  shall  be  liable  to  an  action  for  damages  therefor 
.  .  .  ."  In  order  that  the  imitation  may  be  actionable,  the  com- 
modity bearing  it  must  compete  in  use  and  sale  with  that  on  which 
the  original  trade-mark  is  used.  The  penalties  of  the  law  extend 
to  restraining  by  injunction  the  use  of  the  imitation,  assessing 
damages,  or  imposing  a  fine  or  imprisonment  on  the  infringer.  The 
Trade-Mark  Division  of  the  United  States  Patent  Office  rejects  a 
trade-mark  offered  for  registration,  if  found  likely  to  be  confused 
with  another  trade-mark  previously  registered  for  like  goods. 

(e)  The  Ethics  of  Infringement — Too  little  attention  has  been 
given  to  this  aspect  of  the  subject,  to  require  much  notice,  or  to  be 
of  any  practical  significance.  The  little  that  exists  may  be  found 
in  the  rhetorical  denunciations  of  the  plaintiff's  counsel,  or  in  the 
court's  reprimand  to  the  infringer. 

(/)  The  Psychology  of  Trade-mark  Infringement. — In  our  treat- 
ment of  the  subject  attention  will  be  directed  mainly  to  this  topic 
and  its  application  to  (d)  the  laws  and  court  decisions  relating  to 
infringement. 

3.  Legal  Outlook 

In  view  both  of  the  great  commercial  importance  of  trade-marks 
and  the  desirability  of  an  exact  administration  of  justice  in  any  case, 
the  legal  procedure  which  determines  the  measure  of  protection  to 
be  extended  to  a  trade-mark  should  be  trustworthy.  That  it  is  not 
so  in  fact  is  evident  from  the  lack  of  any  scientific  tests  for  de- 
termining questions  of  infringement,  from  the  blind  manner  in 
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is,    consequently,   no  harmony  in  the  decisions  on   questions  of 
confusion. 

Unless  legal  procedure  is  satisfied  to  adopt  psychological  methods, 
an  innovation  which  seems  more  radical  than  it  really  is,  the  solu- 
tion of  the  problem  before  the  courts  will  not  become  easier  as  time 
goes  on.  Rather  it  will  become  increasingly  difficult  and  probably 
leas  accurate.  New  trade-marks  are  introduced  to  the  public  by 
thousands  annually.  Up  to  December  31,  1915,  there  were  over 
one  hundred  thousand  trade-marks  registered  in  the  United  States 
Patent  Office,  while  each  year  shows  annual  additions  to  this  num- 
ber of  about  seven  thousand  trade-marks.  But  the  number  of  un- 
registered trademarks  in  use  is  several  times  the  number  of  those 
registered.  Thus,  with  each  year's  increase  in  the  number  of  trade- 
marks in  use,  conflict  of  marks  becomes  more  prevalent  and  litiga- 
tion increases.  It  has  also  been  observed  that  the  subtlety  of  in- 
fringers, in  devising  more  cunning  methods  of  imitations,  tends  to 
outstrip  the  slowly  advancing  wheels  of  justice.  To  suppress  the 
infringements  on  their  trade-marks,  some  firms  spend  vast  sums  of 
money  in  litigation;  some  even  maintain  special  legal  departments, 
to  fight  trade-mark  infringement  and  unfair  competition.  As  many 
as  four  or  five  hundred  suits  have  been  instituted  by  one  well  known 
eompany  against  infringers  of  its  trade-marks,  labels  and  packages. 
A  casual  examinations  of  court  records,  or  the  perusal  of  any  text- 
book on  trade-marks  will  show  that  the  most  aggressive  prosecutors 
of  infringers  are,  in  many  instances,  among  the  most  successful 
business  houses  in  the  country.  The  owners  of  these  valuable  trade- 
marks are  not,  however,  the  only  ones  who  suffer  from  the  inac- 
curacy of  court  decisions.  Rich  and  powerful  houses  are  able  to 
demand  the  suppression  even  of  very  remote  imitations  and  to  win 
their  contentions  in  the  courts,  simply  because  they  are  able  to  throw 
a  greater  weight  of  authority  and  prestige  into  their  prosecution 
of  the  case,  than  can  be  mustered  by  an  obscure  antagonist.  Thus 
the  uncetrainty  of  present  judicial  methods  of  determining  in- 
fringement assists  the  larger  and  more  resourceful  business,  often 
probably  in  good  faith,  to  oppress  the  smaller,  and  to  stifle  legitimate 
competition. 

4.  Scope  op  the  Work 

Not  only  because  of  their  commercial  and  legal  significance  have 
we  dwelt  at  length  upon  these  infirmities  of  our  judicial  procedure, 
but  because  it  is  the  task  of  psychology  to  provide  their  remedies. 
Our  study  of  the  problem  does  not  pretend  to  furnish  a  final  solu- 
tiazL     We  realize  that  this  is  only  the  beginning,  and  that  m\M&i 
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been  made  of  some  of  the  psychological  factors  entering  into  con- 
fusion.   By  examining  the  methods  employed  in  devising  imita- 
tions, several  principles  have  been  formulated  as  a  general  guide 
to  aid  in  the  detection  of  dangerous  imitations.    Other  points  of 
interest,  especially  to  the  psychologist,  include,  the  positive  correla- 
tion found  between  the  results  of  the  recognition  and  relative  posi- 
tion methods,  and  between  the  results  of  the  recognition  method, 
when  used  both  with  and  without  knowledge  on  the  part  of  the 
subjects  experimented  upon,  of  the  presence  of  imitations  in  the 
experiment. 

Psychology  hopes  to  render  a  service  to  law  and  business  in 
this  field  by  placing  their  problems  upon  scientific  foundations.  By 
thus  simplifying  the  task  of  the  courts  much  labor  may  be  saved. 
The  expenditure  of  time  and  money  by  the  state,  by  courts,  and  by 
litigants  will  doubtless  be  greatly  lessened.  By  the  application  of 
scientific  methods  more  consistent  and  harmonious  decisions  will  be 
rendered,  and  a  system  of  trade-mark  law  more  practically  useful 
and  more  scientifically  symmetrical  will  be  developed. 

In  Chapter  I.  the  literature  relating  to  our  problem  is  reviewed. 
In  Chapter  II.  the  technique  and  material  employed  are  described. 
Chapter  III.  gives  actual  measurements  of  the  amount  of  confusion 
between  deceptively  similar  trade-marks.  Chapter  IV.  deals  with 
confusion  as  measured  relatively.  In  those  chapters  two  illustra- 
tive scales  of  confusion  between  trade-marks  are  shown,  and  their 
construction  is  demonstrated.  Chapter  V.  presents  the  results  of 
two  psychological  tests  on  the  accuracy  of  the  judicial  decisions, 
together  with  some  of  the  principals  to  be  applied  in  detecting 
dangerous  imitations. 
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degree  of  similarity  necessary  to  constitute  infringement  were 
agreed  upon,  all  uncertainty  would  disappear.  This  work  was  taken 
up  by  Dr.  G.  A.  Feingold  in  a  monograph  that  is  reviewed  later  on 
in  this  chapter. 

The  year  following  the  first  appearance  of  Munsterberg's  article 
brought  forth  an  article8  by  Mr.  Edward  S.  Rogers,  a  patent  lawyer 
of  the  Chicago  bar.  Chronologically  Sogers'  article  should  have 
appeared  first,  for  it  was  he  who  suggested  to  Miinsterberg  the  ap- 
plication of  psychology  to  problems  of  trade-mark  imitation. 
Sogers  gives  a  critical  analysis  of  the  judicial  procedure  from  the 
legal  point  of  view.  He  believes  that  cases  of  trade-mark  infringe- 
ment and  other  similar  forms  of  unfair  trading  show  an  "  irrecon- 
cilable conflict,"  due  to  the  courts'  neglect  of  the  psychology  of 
the  unwary  purchaser.  In  the  following  paragraph  Rogers  illus- 
trates how  the  unwary  purchaser  is  merely  a  judicial  myth : 

"...  when  the  court  thinks  the  exhibit  sufficiently  alike  that  a  judicially 
ideal  unwary  purchaser  ought  reasonably  to  be  deceived  and  one  steps  forward 
and  testifies  that  it  has  happened,  it  is  hailed  as  a  confirmation  of  the  court's 
judgment  and  much  is  made  of  the  testimony,  but  if  in  such  a  case  no  testimony 
of  actual  deception  is  adduced  the  "unwary  purchaser"  is  pressed  again  into 
•erriee  on  the  pretext  that  he  is  in  the  course  of  his  imaginary  purchasing  to  be 
imposed  upon  by  the  imitation,*  ..." 

The  unwary  purchaser  is  usually  assumed  to  represent  the  aver- 
age person,  but  sometimes  he  is  identified  with  any  type  of  indivi- 
dual   This  is  indicated  in  two  statements  by  Rogers,  who  strangely 
enough  seems  not  to  have  been  aware  of  the  contradiction.    In  the 
one,  the  unwary  purchaser  is  distinguished  from  the  intelligent,  ex- 
pert, and  careful  person,  and  identified  with  the  ultimate,  ordinary, 
normal,  everyday,  unpracticed,  inattentive  and  ignorant  purchaser.8 
In  the  other,  it  is  explicitly  stated  that  the  unwary  purchaser  may 
appear  in  almost  any  station  in  life.6    With  such  different  interpre- 
tations of  terms  it  seems  impossible  to  attain  consistent  decisions. 

In  a  very  interesting  book,7  Rogers  takes  up  in  a  critical  manner 
an  historical  survey  of  the  development  of  trade-marks  and  of  judi- 
cial procedure  relating  to  trade-marks,  and  gives  a  number  of  useful 
suggestions,  on  the  economic  and  advertising  aspects  of  trade-marks. 
In  criticism  of  the  present  judicial  procedure,  he  writes : 

•"The  Unwary  Purchaser:  A  Study  in  the  Psychology  of  Trade-Mark  In- 
fringaneiit,"  Michigan  Law  Bev.,  1910,  8,  613-622. 
</W<L,  p.  621. 
5/Wd.,  pp.  613-614. 
•IMd.,  pp.  615-616. 
'"Good  WiU  Trade-Marks,  and  Unfair  Trading,"  1914. 
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In  1911  Mr.  Arthur  Wm.  Barber,  Secretary  of  the  United  States 
Trade-Mark  Association,  studied  the  problems  of  trade-mark  in- 
fringement and  unfair  competition  from  the  legal  and  psychological 
standpoints.11  He  believes  that  every  trade-mark  problem  is  a  psy- 
chological problem,  and  that  the  legal  rules  governing  their  use  will 
gain  immeasurably  in  certainty  and  definiteness  from  the  applica- 
tion of  psychology  thereto.  He  says  that  the  greatest  service  that 
the  psychologist  can  render  is  in  solving  questions  of  infringement 
of  trade-marks  and  imitations  of  packages.  How  primitive  the  legal 
procedure  in  such  cases  is  he  shows  plainly  in  the  following  remarks : 

"Usually  in  our  helplessness,  we  bring  the  trade-marks,  labels  or  packages 
into  the  court,  show  them  to  the  judge,  and  according  as  we  are  on  one  side  of 
the  ease  or  the  other,  point  out  their  likenesses  or  analyze  their  differences. 
Then  the  judge,  in  the  exercise  of  his  judicial  common-sense,  settles  the  rights  of 
the  parties  as  they  look  to  him."" 

"What  we  get  from  the  court  in  a  case  thus  presented  is  never  the  determina- 
tion of  a  fact  upon  conflicting  evidence,  but  the  mere  opinion  upon  the  probabil- 
ity of  a  future  event,  the  deception  of  the  purchaser,  "** 

This  author  thinks  that  experiment  should  determine  the  degree 
of  ease,  or  difficulty  with  which  an  average  person  recalls  the  im- 
pression made  upon  him  by  an  article  which  he  is  used  to  buy ;  as 
well  as  the  clearness  or  haziness  of  that  impression,  and  the  extent 
to  which  the  clearness  of  that  impression  varies  with  the  character 
of  the  article,  its  uses,  and  its  price.  The  vividness  of  the  recollec- 
tion of  the  original  article  depends  on  the  character  of  the  trade- 
mark, the  intelligence  of  the  purchaser,  the  importance  and  the 
frequency  of  the  transaction,  e.  g.y  whether  the  article  purchased  is 
a  eigar  or  a  piano.  Furthermore,  experiment  should  be  able  to 
determine  upon  what  particular  features  of  a  given  trade-mark, 
label,  or  style  of  packing  recognition  mainly  depends;  and  what 
degree  of  similarity  to  the  familiar  form  of  the  original  article,  its 
style  of  marking  or  packing,  is  confusing.  Barber  concludes  with 
a  pleasing  picture  of  the  improvements  in  the  methods  and  results  of 
judicial  inquiry,  when  the  testimony  of  psychology  shall  replace  the 
conjectures  of  the  court. 

The  only  case  that  J  have  been  able  to  find  containing  anything 
like  a  psychological  test  of  confusion  is  one  that  came  up  in  the 
Patent  Office  in  1912."    The  word  "King"  had  been  refused  regis- 

i*"The  Psychology  of  Trade-Marks,"  Bulletin  of  the  U.  8.  Trade-Mark 
Arnm^  1911,  7, 152-165. 

**/*&,  p.  162. 

14/M&,p.  163. 

» Ms  parte,  J.  C.  Blair  ft  Co.,  2  Trade-Mark  Bep.,  483,  104  Ms.}  Deo.,  *&*, 
Jsbjl  18»  If  13,  Manuscript  Decision  of  the  Patent  Office. 
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tration  by  the  Examiner  of  Trade-Marks,  because  of  its  deceptive 
similarity  to  the  previously  registered  trade-mark  "Shen-King" 
used  in  connection  with  similar  goods.  This  decision  was,  on  appeal, 
over-ruled  by  the  Assistant  Commissioner,  and  the  word  "King" 
was  admitted  to  registration.  On  the  argument,  applicant's  counsel 
stated  that,  in  a  test  made  by  him,  the  adult  members  of  his  family 
said  that  they  would  not  purchase  paper  bearing  the  trade-mark 
"Shen-King"  when  they  desired  to  purchase  the  paper  marked 
"King."  The  Assistant  Commissioner  states  that  he  put  the  test  to 
several  employees  in  the  Patent  Office  and  a  majority  immediately 
responded  that  they  would  not  be  confused  by  the  concurrent  use  of 
the  two  marks. 

Both  counsel  and  the  Assistant  Commissioner  committed  the 
error  of  testing  for  the  confusion  of  "Shen-King"  with  "King." 
Their  questions  sought  information  as  to  whether  goods  of  the 
original  or  first  mark  "Shen-King"  would  be  mistaken  for  those  of 
the  second  or  imitative  mark  "King;"  What  (in  fact  usually 
happens  in  the  use  of  trade-marks  is  that  acquaintance  is  first  formed 
with  the  original  or  earlier  mark,  and  that  confusion  is  more  likely 
to  happen  in  the  direction  of  mistaking  the  imitation  which  appears 
later  for  the  original  than  of  mistaking  the  original  for  the  imitation. 

The  language  of  the  law  and  of  the  judicial  decisions  is  clear 
that  the  confusion  to  be  considered  is  that  of  the  imitation  with  the 
original.  That  there  may  be  an  equal  amount  of  confusion  of 
"King"  with  "Shen-King"  as  of  "Shen-King"  with  "King"  would 
be  no  reason  for  using  the  couplet  of  trade-marks  in  the  latter  order. 
Tho  there  would  in  some  cases  be  little  or  no  difference  in  the  amount 
of  confusion  found  by  means  of  either  couplet,  in  other  cases  there 
may  be  a  great  deal  of  difference.  Neither  the  Assistant  Commis- 
sioner nor  the  applicant's  counsel  give  any  figures  from  their  tests. 
The  counsel's  family  were  unanimous  that  in  their  opinion  the 
goods  under  the  two  trade-marks  would  not  be  confused.  But  a  test 
for  the  deceptive  similarity  of  trade-marks  is  not  necessarily  de- 
termined by  the  existence  of  deceptive  similarity  between  their  goods. 
It  is  not  clear  from  the  record  whether  the  majority  of  the  Patent 
Office  employees  would  not  have  been  confused  by  either  the  goods 
or  by  the  names.  Furthermore,  the  opinions  of  those  tested  do  not 
give  information  as  to  the  actual  existence  or  non-existence  of  con- 
fusion. The  reliability  of  the  counsel's  statement  must  be  decidedly 
lowered  in  view  of  the  probable  prejudice  resulting  from  the  wish 
of  his  family  to  see  him  win  the  case.  The  Patent  Office  employees 
are  also  unsuitable  subjects  for  tests  of  this  character,  because  they 
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are  a  specially  skilled  class  of  individuals,  who  are  more  than  ordi- 
narily familiar  with  the  subject  of  imitations. 

An  imitation  trade-mark  and  its  article  may  not  only  be  mis- 
taken for  the  original  trade-mark  and  its  article  but  may,  as  Pro- 
fessor Hollingworth  remarks,  simply  remind  us  of  the  latter  or  the 
general  atmosphere  surrounding  it.19  A  trade-mark  should  popu- 
larize the  article  on  the  market  and  then  keep  it  popular,  by  virtue 
of  its  being  easily  recalled,  recognized,  and  asked  for.  To  effect  the 
choice  of  such  a  trade-mark  the  memorability  of  different  kinds  of 
facts  must  be  considered.    As  Hollingworth  says : 

"In  selecting  a  trade-mark  by  which  goods,  designed  for  popular  consump- 
tion, are  to  be  known,  it  is  of  real  value,  for  instance,  to  know  that  persons,  and 
face*  are  more  easily  remembered  than  objects,  and  objects  more  easily  than 
action*;  that  form  is  more  easily  remembered  and  recognized  than  numbers. 
More  numbers  can  be  remembered  than  colors,  but  they  are  likely  to  be  wrongly 
remembered  or  remembered  as  existing  in  a  false  order  or  position."" 

He  also  found  that  the  relative  accuracy  in  reporting  different 
kinds  of  facts  when  subjects  are  directly  questioned  about  them,  runs 
from  97  to  less  than  8  per  cent.  The  order  of  accuracy  is :  presence 
of  things,  number  of  people,  space  relations,  conditions  of  objects, 
order  of  events,  color,  size  and  quantity,  sound,  time,  and  actions. 
From  this  we  may  infer  that,  as  parts  of  a  trade-mark,  these  features 
are  likely  to  play  varying  roles  in  producing  confusion. 

In  a  second  experiment,  perhaps  the  first  psychological  study  of 
trade-marks,  Hollingworth  found  large  variations  in  the  relative 
attention  and  memory  value  of  geometrical  forms  representing  many 
common  trade-marks  symbols.18  The  correct  recognitions  ranged 
from  28  to  92  per  cent.  "The  general  principle  suggested  by  this 
experiment  is  that  those  forms  are  best  remembered  to  which  specific 
names  can  be  given,  as  'star,' ' crescent,'  'crown,'  etc." 

In  this  connection,  Miss  Edith  Mulhall  working  with  pictures, 
forms,  words,  and  nonsense  syllables  suggests  also  that  trade-marks 
having  a  wealth  of  associations  will  be  recalled  and  recognized 
more  easily.19 

There  is  no  doubt  that  upon  the  recognitive  value  of  a  trade- 
mark may  depend  its  chances  of  being  displaced  by  an  imitation.    In 
his  ehapter  on  "The  Psychology  of  Trade-marks  and  Trade-Names," 
Hollingworth  emphasizes  the  principle  that  trade-marks  to  be  vain- 
ly "Advertising  and  Selling,"  1913,  198. 
it  JWdL,  pp.  208-210. 
u  IM&,  pp.  212-213. 

""Experimental  Studies  in  Recognition  and  Recall,"  Amer.  J.  of  Psychol., 
J01S,  16,  118,  22«. 
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the  stimulus  word  was  the  name  of  the  commodity.  When  the  trade- 
mark was  the  stimulus  the  subject  was  asked  to  respond  by  naming 
the  first  commodity  suggested,  and  vice  versa.  Dr.  Adams  believes 
that  this  experiment  is  ' '  a  measurement  of  the  advertisements  which 
have  been  most  effective  with  any  given  individual."  His  tables 
clearly  show  which  trade-marks  are  most  often  thought  of  in  con- 
nection with  their  commodities ;  and  which  commodities  bear  trade- 
marks that  are  well  known,  or  little  known.  The  commodities  most 
widely  advertised  were  most  frequently  mentioned  in  the  experi- 
ments. Another  experiment  of  Adams  showed  a  certain  amount  of 
confusion  between  trade-marks  and  slogans,  and  between  the  com- 
modities to  which  they  were  attached,  and  pointed  to  inefficiency  in 
advertising.15  He  cites  a  number  of  tables  from  a  study  by  Cheney.20 
They  indicate  the  strength  of  associations  between  the  following 
couplets:  firm  names  and  their  products,  trade-marks  and  their 
products,  trade-marks  and  their  firm  names,  firm  names  and  their 
trade-marks,  slogans  and  their  firm  names.97 

A  very  interesting  and  instructive  study  has  been  made  by  Dr. 
Ij.  B.  Geissler  in  connection  with  trade-marks  and  commodities.28 
He  planned  to  see  how  one  could  be  best  persuaded  to  buy  a  certain 
brand  of  goods  and  to  obtain  a  "general  insight  into  the  mind"  of 
*  prospective  purchaser  of  a  given  article.  To  do  this  experiments 
were  conducted  to  see  which  brands  of  articles  are  thought  of  first, 
most  frequently,  and  why. 

In  an  earlier  study  by  the  writer29  of  the  accuracy  of  court  deci- 
sions, on  questions  of  confusion  of  trade-marks,  the  figures  represent- 
ing the  percentage  of  confusion  produced  by  infringing  and  non- 
infringing imitations  are  incorrect.  More  careful  examination  of 
the  litigated  cases  from  which  these  imitations  were  selected  indicated 
that  some  were  not  appropriate  for  use  in  testing  the  accuracy  of 
the  decisions.  The  authors  of  the  textbooks  from  which  some  of  the 
imitations  were  selected  had  committed  numerous  errors,  as  was  later 
discovered.  This  necessitated  the  omission  of  a  number  of  imita- 
tions that  had  been  included  among  the  infringements  and  non- 
infringements, and  accordingly  changed  the  average  amounts  of  con- 
fusion and  the  average  percentage  of  overlapping,  which  gave  the 

*  JH&,  pp.  203-204. 

m  IMA,  pp.  17S-179. 

**  Printer's  Ink,  August,  1914,  61-62. 

«"A*soeis4ioa-Beactioiis  Applied  to  Ideas  of  Commercial  Brands  of  Fa- 
m&*t  Articles,"  '«"•  of  Applied  PsychoL,  1917,  1,  275-290. 

*•  "Experiment  versus  Court  Decision,"  an  abstract  of  a  paper  read  before 
ffce  New  York  Branch  of  the  Am.  PsychoL  Ass.,  J.  of  FMlo*.,  PqydHoU,  Etc, 
ISIS,  IS,  4fr-47. 
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measure  of  the  accuracy  of  the  decisions.  Nevertheless,  the  general 
conclusion  of  the  experiment, — that  the  judicial  decisions  were  unre- 
liable,— remains  unimpaired. 

Dr.  Gustave  A.  Feingold,  working  under  the  direction  of  Miinster- 
berg,  has  made  a  very  interesting  study  that  is  more  related  to  our 
own  than  is  any  other  that  has  been  so  far  made.30  The  purpose  of 
his  investigation  was  to  supply  "a  scientific  guide  to  courts  of  law 
whereby  they  could  settle  disputes  arising  from  Trade-Mark  In- 
fringement more  equitably.'131  His  study  is  also  suggestive  and 
valuable  to  psychological  theory  because  he  made  several  important 
discoveries  about  recognition. 

Before  considering  his  guide  or  Correction  Formula  for  the  courts 
we  shall  briefly  review  his  methods  and  some  of  his  findings.  In 
one  set  of  his  experiments  Feingold  used  words  as  his  material  and 
in  another  picture  post-cards.  Two  methods  were  used  by  him  in 
getting  the  objective  similarity  of  the  various  pairs  of  words,  the 
"mathematical"  and  the  " psychological,' '  as  he  calls  them.  He 
alone  measured  the  mathematical  similarity  by  rating  each  pair  of 
words,  on  a  percentage  basis,  according  to  the  number  of  sym- 
metrically or  correspondingly  arranged  identical  letters  that  they 
contained.  The  psychological  similarity  was  obtained  by  having 
35  individuals  estimate  the  similarity  of  each  pair  of  words  in  terms 
of  percentage.  The  next  step  was  to  see  how  well  each  pair  of  words 
could  be  recognized.  Eight  words  were  typewritten  in  capital 
letters  in  two  vertical  columns  on  3-  by  5-inch  plain  filing  cards. 
These  cards  came  in  pairs ;  the  first  was  the  original  card  shown  to 
the  subject ;  and  the  second  the  variable  which,  with  the  exception  of 
the  change,  was  a  reproduction  of  the  first.  In  all  the  experiments 
the  interval  between  the  first  and  second  exposure  was  twenty 
seconds.  The  original  and  variable  cards  were  each  exposed  for 
four  seconds.  The  cards  were  seen  thru  a  window  opened  and 
closed  by  a  drop  shutter.  Before  the  experiment  began  the  subject 
was  told  that  he  would  be  required  to  name  on  the  second  card  all 
the  words  that  were  changed  and  the  original  ones  that  had  been 
displaced.  On  the  variable  card  all  the  words  might  be  changed, 
all  but  one,  only  one,  or  none,  i.  e.9  8,  7,  1,  or  0.  After  the  recogni- 
tions, introspections  were  asked  for. 

In  connection  with  the  experiments  with  words,  three  methods 
of  recognizing  an  object  were  noted:32  (1)  by  memory  images  that 

ao  "  Becognition  and  Discrimination, ' '  Psychol,  Bev.,  Monogr.,  1915,  18, 
No.  78. 

si  Ibid.,  p.  111. 
« Ibid.,  pp.  44-45. 
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persist  from  the  presentation  to  the  test;  (2)  by  the  revival  of  faded 
memory  images  thru  the  re-perception  of  the  original  object  or  merely 
by  the  perception  of  the  position  originally  occupied  by  the  missing 
object;  or  (3)  it  may  be  a  matter  of  feeling,  kinesthetic  attitude, 
adjustment,  or  of  the  revival  of  a  mood.  In  connection  with  the 
post-card  experiments  two  methods  of  recognition  were  observed.88 
The  variable  card  was  recognized  because  it  lacked  something  that 
appeared  on  the  old  card,  or  because  a  new  element  was  noticed. 
Among  the  objective  factors84  that  determined  recognition,  a  change 
of  position,  as  right  and  left,  up  and  down,  was'  the  most  easily 
recognizable  factor ;  change  of  direction  was  next  most  easily  recog- 
nized ;  human  beings  were  more  distinguishable  in  various  attitudes 
than  animals;  and  animate  things  were  in  general  more  distinguish- 
able than  inanimate. 

Prom  a  comparison  of  the  introspective  and  objective  data,  Fein- 
gold  brings  out  the  following  points,  which  are  instructive  in  a  psy- 
chological analysis  of  errors  of  recognition  :85  Failure  to  remember 
the  original ;  incomplete  perception  of  the  original ;  incomplete  per- 
ception of  the  variable,  mistaking  it  for  the  original,  owing  to  the 
superiority  of  the  ideo-motor  force  over  the  sensory-motor  force. 
"With  high  similarity  the  majority  of  errors  are  due  to  the  oblitera- 
tion from  memory  of  the  original  N  [normal]  impression  by  the  per- 
ception of  the  V  [variable]  stimulus,  owing  to  the  superiority  of  the 
sensory-motor  force  over  the  ideo-motor  force. "  "  Doubt  arises  from 
a  conflict  of  these  two  factors — the  perception  or  the  memory 
triumphing  according  as  objective  similarity  is  high  or  low. ' '  Errors 
also  occur  with  the  rise  of  a  new  association  in  connection  with  the 
original  which  makes  it  seem  new ;  and  with  the  failure  of  the  orig- 
inal to  revive  the  same  associations  as  when  first  presented. 

The  complexity  of  the  picture-post  cards  made  it  difficult  to 
analyze  the  errors  of  recognition,88  but  by  far  the  majority  of  errors 
were  due  to  the  obliteration  from  memory  of  the  original  by  the 
perception  of  the  variable.  The  feeling  familiarity  aroused  by  the 
identity  of  the  other  cafds  was  another  source  of  error.  "In  gen- 
eral, the  mistakes  were  directly  due  to  the  degree  of  similarity,  ..." 

His  experiments  took  up  the  following  variants:37  (1)  The  effect 
on  recognition  of  the  distribution  of  attention;  (2)  of  the  time  of 
perception;  (3)  of  similarity  and  whether  there  is  a  "mathematical" 

"  Ibid.,  p.  92. 

s*  Ibid.,  pp.  98-99. 

» Ibid.,  p.  49. 

*•  IWL,  pp.  99-100. 

^  Ibid.,  p.  8. 


\ 


HISTORICAL  ACCOUNT  19 

hold  only  approximately,  the  variations  running  from  2  per  cent,  to 
12  per  cent,  in  the  uncorrected  results,  and  from  4  per  cent,  to  17 
per  cent,  in  the  corrected  results.  The  duplicate  and  new  scores  are 
not  taken  into  account  here.  When  the  two  scores  of  the  individual 
pairs  of  words  are  consulted,  the  variations  run  from  0  per  cent,  or 
exact  agreement  to  62  per  cent,  or  more  than  six-tenths  of  the  dis- 
tance to  complete  disagreement;  these  are  uncorrected  results  and 
no  corrected  ones  are  given.  When  the  variations  from  a  formula 
(which  does  not  indicate  that  there  are  any  divergencies)  are  as 
large  as  62  per  cent,  at  a  single  step,  the  extremes  of  the  scale  differ- 
ing by  only  100  per  cent.,  it  is  objectionable  to  state  that  the  inverse 
relation  is  a  simple  or  exact  one.  Furthermore,  no  figures  are  given 
to  show  the  limits  within  which  the  relation  between  degree  of  simi- 
larity and  recognition  is  inverse.  There  is  no  doubt  that  among 
many  words  an  inverse  relation  holds,  but  Feingold's  results  do  not 
justify  the  ratio  X:  (100 — X).45  Neither  do  the  tables  containing 
the  results  of  the  picture-post  cards  experiments  reveal  evidence  for 
this  simple  inverse  relation. 

Any  guide  for  practical  application  in  the  courts  should  be  good 
psychology,  and  should  be  examined  carefully  by  psychologists. 
Feingold  offers  a  Correction  Formula  as  a  guide.  It  is  stated  in  his 
preface  that  to  furnish  such  a  guide  it  is  necessary  "to  construct  a 
scale  of  graded  similarity  among  meaningful  objects  of  the  same 
category,  and  then  to  find  out  what  relation  there  exists  between 
each  unit  of  the  scale  and  ability  to  recognize  under  such  conditions 
of  attention,  perception  and  judgment  as  most  prevail  in  actual 
life."  But  the  determination  of  the  relation  between  similarity  and 
recognition  is  not  necessary  for  a  scientific  guide  nor  does  Feingold 
show  that  it  is.  This  determination  is  a  very  complicated  affair,  and 
will  therefore  have  to  be  considered  in  detail. 

Feingold  first  proceeds  to  develop  the  Correction  Formula  on  the 
basis  that  between  similarity  and  recognition  there  is  a  simple  in- 
verse relation  in  terms  of  percentage  as  X:  (100 — X)> — a  relation 
which  as  shown  in  the  second  preceding  paragraph  does  not  hold. 
As  the  inverse  relation  is  the  very  thing  the  formula  is  to  effect, 
besides  being  a  guide  for  the  courts,  it  evidently  cannot  obtain  sup- 
port from  it.  The  formula  requires  in  application  much  calcula- 
tion, but  changes  the  score  generally  only  a  little.  It  is  not  possible 
to  analyze  the  errors  in  it  as  he  tries  to  do. 

There  is  still  another  fault  to  be  found  with  Feingold's  formula, 
and  it  is  a  most  important  one  as  it  may  have  a  serious  effect  on 

«•  See  Table*  16,  20,  25,  29,  ibid.,  pp.  71,  73,  78,  83 ;  and  Plata  TL,  ^.  %<L 
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To  obtain  the  correct  result  this  value  (K)  is  added  algebraically 
(with  a  +  or  —  sign)  to  the  percentage  of  correct  recognitions  of 
the  variable  item,  the  percentage  of  whose  similarity  is  given  in  the 
formula. 

The  formula  involves  a  number  of  assumptions  that  seem  to  be 
untenable  and  otherwise  objectionable.  In  the  first  place  the  errors 
or  chance  recognitions  of  the  duplicate  and  new  items  are  carried 
over  to  the  variables.52  The  errors  of  the  variables  should  undoubt- 
edly be  calculated  from  their  own  recognitions,  and  not  be  made  to 
depend  upon  the  errors  of  the  duplicate  and  new  items.  The  psy- 
chological bases  of  the  errors  or  chance  recognitions  of  the  duplicate 
and  new  items  are  not  entirely  the  same  as  those  of  the  variables. 
The  chance  incorrect  discriminations  of  the  duplicates  are  trans- 
muted into  chance  correct  discriminations  of  the  variables.  The 
resort  to  guessing  in  the  case  of  the  chance  incorrect  discriminations 
of  the  duplicates  is  generally  due  to  the  forgetting  of  the  first  of  the 
two  duplicates  and  in  the  case  of  the  chance  correct  discriminations 
of  the  variables  to  the  forgetting  of  the  dissimilar  original.  The 
chance  incorrect  identifications  of  the  new  items  are  also  transmuted 
into  chance  incorrect  identifications  of  the  variables.  The  resort  to 
guessing  in  the  case  of  the  chance  incorrect  identifications  of  the  new 
items  is  due  generally  to  the  failure  to  note  that  the  new  did  not 
appear  in  the  presentation,  and  in  the  case  of  the  variables  to  the 
failure  to  discriminate  the  variable  from  its  original.  Feingold,  of 
course,  considers  that  there  is  a  difference  between  chance  correct 
discriminations  and  correct  discriminations  of  a  variable  and  between 
chance  incorrect  identifications  and  incorrect  identifications;  the 
former  in  each  case  being  the  result  of  a  guess,  and  the  latter  of  a 
conscious  reaction  to  objective  dissimilarity.  Furthermore,  the 
errors  of  the  duplicates  and  of  the  new  items  are  not  calculated  on 
the  same  basis.  The  per  cent,  of  chance  incorrect  identifications  of 
the  new  items  is  computed  from  the  errors  made  in  connection  with 
a  single  new  item  exposed  in  a  test  among  7  duplicates  or  in  an  old 
environment.58    The  per  cent,  of  chance  incorrect  discriminations 

"  IWL,  pp.  23-24,  37. 

»•  Ibid*,  pp.  36,  38,  the  results  of  a  number  of  such  exposures  are  used,  but 
la  tike  fflnstrmtion  of  the  practical  application  on  p.  124  only  one  is  used. 
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tions,  there  are  fewer  chance  incorrect  identifications,  and  vice  versa, 
and  with  the  higher  degrees  of  similarity  and  the  fewer  correct 
discriminations,  there  are  more  chance  correct  discriminations,  and 
vice  versa.  In  other  words,  there  is  a  proportionate  decrease  of 
chance  incorrect  identifications  with  an  increase  of  incorrect  iden- 
tifications, and  there  is  a  proportionate  decrease  of  chance  correct 
discriminations  with  an  increase  of  correct  discriminations.  More- 
over, according  to  Feingold 's  position  there  can  be  no  chance  correct 
discriminations  of  new  items  of  0  per  cent,  similarity,  nor  can  there 
be  any  chance  correct  identifications  of  a  duplicate  item  of  100  per 
cent,  similarity;  and  this  is  implied,  whether  or  not  there  are  any 
errors  of  the  duplicate  and  new  items.  The  assumptions  are  evi- 
dently false.  If,  in  the  experiment,  there  were  no  chance  incorrect 
discriminations  of  the  duplicates,  the  formula  would  not  serve  to 
correct  chance  correct  discriminations  of  the  variables ;  and  if  there 
were  no  chance  incorrect  identifications  of  the  new  items,  the  formula 
would  not  correct  for  chance  incorrect  identifications  of  the  variables. 
The  first  step  in  the  formula  takes  it  for  granted  that  similarity 
and  difference  are  inversely  related  precisely,  i.  e.,  when  the  simi- 
larity is  0  per  cent,  the  difference  is  100  per  cent.,  and  vice  versa ; 
and  when  the  similarity  is  25  per  cent,  the  difference  is  75  per  cent., 
and  vice  versa.  Table  858  of  Feingold 's  monograph  does  not  show 
this  to  be  true;  it  would  hold  perhaps  if  there  were  a  simple  inverse 
relation  between  similarity  and  recognition.  The  inverse  relation 
between  similarity  and  difference,  and  similarity  and  recognition  is 
also  disturbed  by  the  fact  that  Feingold  himself  finds  no  confusion 
below  20  per  cent,  or  25  per  cent,  similarity. 

The  criticism,  in  brief,  of  the  Correction  Formula  is  that  it  is 
based  on  false  psychology,  that  it  is  unscientific,  inaccurate,  and  im- 
practical. Its  practical  outcome  is  quite  negligible.  In  the  closing 
chapter  on  The  Application  of  the  Laws  of  Recognition  to  Juris- 
prudence, Feingold  illustrates  the  application  of  the  recognition 
method  and  the  formula  in  the  court  room.  Tho  the  experiment  is 
adjusted  for  ideal  conditions,  a  few  errors  among  the  duplicate  and 
new  items  cause  Feingold  to  say,  "Now  apparently  either  the  condi- 
tions of  the  experiments  were  not  ideal  or  some  of  the  observers  were 
not  absolutely  normal,  .  .  ."59  The  Correction  Formula  is  then 
applied  to  obtain  the  ideal  results.  The  uncorrected  score  is  42  per 
cent,  of  correct  discriminations  of  the  imitation ;  the  formula  shows 
that  the  amount  of  correction  should  be  +0.5;  and  according  to 

>s  Ibid.,  p.  36. 
»•  Ibid^  p.  125. 
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Feingold's  computation  42.5  per  cent,  of  correct  discriminations  is 
the  ideal  result.  He  has  spent  a  vast  amount  of  labor  to  develop  the 
formula  which  yields  the  insignificant  change  of  +  0.5.  The  erro- 
neous assumptions  on  which  the  formula  rests  and  the  results  ob- 
tained by  it  prove  it  to  be  useless. 

It  would  certainly  be  unfair  to  judge  all  of  Feingold's  work  by 
the  Correction  Formula.  His  experimental  technique  presents  a 
good  study  in  method.  Moreover,  some  of  the  conclusions  that  we 
first  mentioned  will  be  found  to  be  of  decided  psychological  interest 
and  others  to  have  a  direct  practical  bearing  on  various  trade-mark 
problems. 

To  devise  a  scientific  guide  for  the  courts  it  is  not  necessary  to 
establish  a  relation  between  recognition  and  similarity.  Nor  is  it 
possible,  as  Feingold  has  attempted  to  do,  to  analyze  completely  the 
intricate  errors  of  memory.  A  scale  of  confusion  including  a  suffi- 
cient number  of  individuals  to  overcome  such  errors  would  be  all 
that  is  necessary.  In  other  words,  it  is  not  necessary  nor  is  it  pos- 
sible at  the  present  time,  to  arrive  at  a  final  conclusion  regarding 
confusion,  thru  a  synthesis  of  the  many  factors  which  comprise  con- 
fusion. But  it  is  possible  to  measure  directly  the  amount  of  con- 
fusion involved.  And  this  is  just  what  we  have  done  here  as  dis- 
tinguished from  what  Feingold  attempted  to  do. 


CHAPTER  II 

MATERIAL  EMPLOYED  AND  EXPERIMENTAL  PBOGEDUBE 

1.  Material  Employed 

This  chapter  describes  the  trade-marks  used  and  the  manner  of 
conducting  the  experiments.  Sixty  pairs  of  litigated  trade-marks, 
all  word  trade-marks,  were  picked  at  random  from  a  large  number 
of  court  decisions.  The  120  were  all  employed  in  the  experiments ; 
no  trade-marks  consisting  of  or  including  emblems,  designs,  symbols, 
or  devices  were  used.  Sixty  of  these  trade-marks  were  originals, 
and  the  other  60  their  respective  imitations,  which  had  become 
the  subject  of  litigation.  The  collection  represented  many  varying 
degrees  of  deceptive  similarity,  from  a  slight  resemblance  to  approxi- 
mate identity.  Hie  judicial  decisions  involving  these  60  pairs  of 
trade-marks  were  not  wholly  confined  to  questions  of  deceptive  simi- 
larity between  the  word  trade-marks,  and  hence  are  not  homogeneous. 
Some  of  the  judicial  decisions  were  confined  simply  to  questions  of 
the  deceptive  similarity  in  law  of  mere  word  trade-marks,  while 
others  were  complicated  by  the  presence  of  various  other  questions. 
About  one  half  of  the  decisions  are  adjudications  of  infringement, 
restraining  the  use  of  the  imitative  trade-marts,  while  the  other 
half  are  adjudications  of  non-infringement,  permitting  the  use  of  the 
imitation.  The  results  of  the  experiments  with  these  60  pairs  of 
trade-marks  are  given  in  Chapters  III.  and  IV. 

A  second  selection  of  trade-marks  was  made  from  other  than 
litigated  cases.  In  this  selection  there  are  ISO  trade-marks.  They 
were  chosen  at  random  from  advertisements  in  current  magazines, 
trade-journals,  newspapers,  etc.  For  experimental  purposes  60  of 
the  trade-marks  were  selected  from  the  180  and  duplicates  of  them 
were  made.  We  shall  refer  to  both  members  of  each  pair  as  dupli- 
cates or  duplicate  trade-marks.  The  remaining  120  trade-marks  are 
called  new  trade-marks. 

All  the  trade-marks  used  in  the  experiment  were  shown  with  the 

xmunercial  names  of  the  articles  or  commodities  to  which  they  are 

pplied  in  commerce,  thus  Green  River  Whiskey.    The  articles 

^presented  many  classes  of  goods  of  various  descriptive  properties, 

t  example,  soap,  shoes,  flour,  incandescent  lights,  tobacco,  and  oil. 

i  tome  of  the  court  decisions,  however,  the  litigated  pairs  of  trade- 
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of  trade-marks  employed, — the  originals,  the  imitations,  the  dupli- 
cates, and  the  new.  In  all  the  six  sets  there  were  no  other  trade- 
marks that  were  identical  with  the  60  originals,  the  60  imitations,  the 
60  pairs  of  duplicates,  or  the  120  new  trade-marks.  This  was  so  only 
in  the  Uninformed  and  Informed  experiments,  but  not  in  the  Control 
experiment  where  the  imitations  were  omitted  and  duplicates  of  the 
originals  replaced  them.  Unless  otherwise  specified  in  this  study 
the  words  trade-mark,  original,  imitation,  duplicate,  and  new,  alone 
or  in  connection  with  the  word  trade-mark,  signify  the  trade-mark 
itself  plus  the  name  of  its  article. 

The  six  sets  of  trade-marks  were  tried  in  one  sitting,  the  pres- 
entation of  each  successive  set  following  immediately  after  the  test 
of  the  preceding  one.  The  task  was  not  laborious,  and  the  entire 
experiment  did  not  usually  require  over  twenty-five  minutes.  Very 
few  complaints  were  made  in  the  introspections  to  indicate  that  the 
observer  thought  himself  confused  by  having  gone  thru  the  previous 
sets.  The  order  in  which  the  six  sets  were  given  varied  so  that  the 
possible  effects  of  practice  and  fatigue  might  be  equally  distributed 
among  them.  At  the  close  of  the  experiment,  the  question  was 
asked  "How  did  you  react  when  the  words  were  shown  to  you  in  the 
presentation  and  in  the  test  t "  It  was  found  that  in  the  presentation 
that  the  subject  had  as  a  rule  been  able  only  to  read  the  words.  In 
Chapter  V.  only  one  set  of  trade-marks  was  studied. 

The  trade-marks  and  the  names  of  the  articles  were  all  type- 
written in  black  ink  on  small  slips  of  white  paper,  two  and  three 
quarters  by  four  and  one  quarter  inches  in  size.  The  name  of  the 
article  appeared  on  the  line  directly  beneath  the  trade-mark.  Care 
was  taken  to  keep  the  blackness  of  the  ink  the  same  for  all  the  letters 
in  the  words.  All  the  words  appeared  in  the  second  horizontal 
quarter  from  the  top  of  the  slip  of  paper.  The  arrangement  of  the 
words  on  an  original  and  its  respective  imitation  slip  is  shown  below. 

Original  Imitation 


Holeproof 
Hosiery 


Enotair 
Hosiery 


The  following  directions  were  given  to  each  observer  in  the  Un- 
informed and  Informed  groups : 

"Yon  art  going  to  be  shown,  one  at  a  time,  on  slips  of  papei,  a  uumhet  ot 
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attempt,  however,  is  made  to  reproduce  in  the  experiments  the  multi- 
tudinous variations  that  occur  in  everyday  life. 

(5)  Uninformed  Experiment — The  observers  in  the  Uninformed 
group  were  not  told  of  the  purpose  of  the  experiment ;  nor  that  there 
would  be  any  imitations  in  the  test  replacing  some  trade-marks 
shown  in  the  presentation.  In  daily  life  the  circumstances  under 
which  a  trade-mark  is  first  met  with  >and  later  recognized  often  re- 
semble conditions  similar  to  those  of  incidental  memory.4  If  the 
observer  inquired  whether  all  the  trade-marts  shows  in  the  presenta- 
tion were  in  the  test,  or  whether  there  were  imitations  in  the  test 
replacing  some  trade-marks  in  the  presentation,  he  was  told  that 
these  questions  could  not  be  answered  until  after  the  experiment 
was  over.  Nothing  was  said  or  done  by  the  experimenter  to  lead 
the  observer  to  suspect  that  there  were  imitations  in  the  test  and 
that  their  originals  were  omitted.  Yet,  if  the  observer  said  "here  is 
a  slip  on  which  the  trade-mark  is  different,  but  the  name  of  the 
article  is  the  same  as  that  which  was  seen  the  first  time  in  the  pre- 
sentation," and  that  he  did  not  know  whether  it  was  correct  to  say 
he  had  seen  the  slip,  he  was  told  that  if  all  the  words  on  the  slip 
were  exactly  the  same  as  those  seen  before  he  should  say  that  he  had 
seen  it,  if  all  the  words  on  the  slip  were  not  exactly  the  same  he 
should  say  that  he  had  not  seen  it.  Even  those  observers  who  showed 
by  their  remarks  or  behavior  that  they  noticed  a  catch  in  the  experi- 
ment and  were  consequently  on  the  alert  against  being  deceived,  were 
nevertheless  later  often  deceived. 

(c)  Informed  Experiment — In  addition  to  the  directions  given 
in  the  Uninformed  experiment  the  Informed  observers  were  told  of 
the  purpose  of  the  experiment.  They  were  informed  that  they  were 
going  to  be  shown  20  trade-marks  and  the  names  of  their  articles 
in  the  presentation,  and  that  in  the  test  there  would  be  40,  10  iden- 
tical with  10  shown  in  the  presentation,  10  imitations,  and  20  new. 
Besides  picking  out  the  slips  that  were  the  same  as  those  in  the 
presentation  and  those  that  were  new,  they  were  asked  also  to  pick 
out  those  that  were  changed.  Their  knowledge  and  caution  against 
imitations  were  of  course  much  greater  than  in  the  case  of  the  Un- 
informed group. 

(d)  Control  Experiment. — The  directions  in  the  Control  experi- 
ment were  the  same  as  in  the  Uninformed,  but  the  formation  of  the 
test  was  different.  The  purpose  of  this  experiment  was  to  study  the 
recognitive  value  of  the  originals  and  to  determine  how  well  the 

«In  this  connection  Q.  C.  Myer's  monograph  gives  some  interesting  results 
of  the  inaccuracy  of  knowledge  of  familiar  objects  and  events,  "A.  f&u&y  \& 
Ixeidantml  Memory,"  Arck.  of  Psychol,  1913,  No.  26. 
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Each  observer  was  given  an  envelope  and  a  sheet  of  directions. 
Enclosed  in  the  envelope  were  50  slips  of  white  paper,  containing  the 
50  pairs  of  trade-marks  and  their  articles.    The  directions  were : 

"Please  arrange  the  enclosed  slips  in  an  order  of  merit  according  to  the 
following  directions. 

"Each  slip  contains  two  trade-marks  of  a  common  article.  The  upper  is  the 
original  trade-mark  and  the  lower  is  the  imitation  of  it. 

"The  different  pairs  of  trade-marks  on  the  different  slips  vary  in  their 
likelihood  of  confusion,  or  in  their  deceptive  similarity,  or  in  the  likelihood  that 
the  imitation  trade-mark  will  be  mistaken  for  the  original.  This  confusion  may 
be  due  to  the  appearance  of  the  trade-marks,  their  sound,  their  meaning  or  sig- 
nificance, or  any  combination  of  these  three  factors.? 

"Arrange  the  slips  according  to  their  likelihood  of  confusion  as  follows: 
Put  in  the  grade  marked  0  those  slips  whose  trade-marks  would  cause  absolute 
non-confusion.  Put  in  grade  1  those  which  would  cause  the  least  amount  of  con- 
fusion, in  grade  2  those  which  would  cause  a  little  more  confusion,  in  grade  3 
those  which  would  cause  still  more  confusion,  and  so  on  up  to  grade  10  which 
represents  absolute  confusion.    The  intervals  between  the  grades  are  all  equal. 

"It  is  not  required  that  an  equal  number  of  slips  be  put  in  each  grade,  nor 
that  every  grade  be  used. 

"In  arranging  the  slips  consider  each  trade-mark  as  if  you  have  had  no 
previous  experience  with  it. 

"Finally,  it  must  be  remembered  that  the  name  of  the  article  forms  no  part 
of  the  trade-mark." 

In  addition  the  observer  was  told  that  there  was  no  time  limit, 
and  that  he  could  take  as  long  as  he  wished  to  make  the  arrangement. 
He  was  allowed  to  rearrange  the  order  until  it  satisfied  him.  When 
the  observer  indicated  that  he  was  satisfied  with  his  arrangement, 
he  was  asked  to  state  how  he  did  it. 

Fifty  college  students,  25  men  and  25  women,  acted  as  judges* 
They  were  students  of  psychology  at  Columbia  University  during 
the  fall  of  1914.  No  observer  in  this  experiment  took  part  in  the 
others. 

By  stating  in  the  directions  that  the  intervals  between  the  grades 
are  all  equal  the  intention  was  to  answer  in  advance  any  question  in 
this  regard,  and  to  give  the  impression  that  they  were  not  to  be  con- 
sidered unequal.  Yet  it  is  not  believed  that  the  observer  in  grad- 
ing always  considered  the  differences  between  the  grades  equal,  ik>r 
that  he  could  always  be  so  exact  in  making  his  judgments.  Thus 
it  cannot  be  maintained  that  the  same  amount  of  difference  between 
the  average  grades  of  two  pairs  of  trade-marks  in  two  different 
regions  of  the  scale  stand  for  equal  objective  differences  in  deceptive 
similaritiy.    In  spite  of  all  this,  the  inclusion  of  the  above  state* 

'Another  factor  that  might  have  been  included  is  similarity  in  linguistic 
formation. 
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The  serial  form  of  the  relative  position  method  used  in  Chapter 
V.  differs  from  the  group  form  in  that  it  permits  the  trade-marks 
to  be  graded  without  any  gaps  between  them  in  an  unbroken  con- 
tinuum. In  this  experiments  there  were  9  pairs  of  litigated  trade- 
marks picked  at  random  from  simple  decisions.  They  were  studied 
also  by  the  recognition  method.  Their  results  test,  as  has  been 
mentioned  before,  the  accuracy  of  the  judicial  decisions.  The  de- 
parture from  the  instructions  in  the  group  form  will  be  observed. 

"Please  arrange  as  well  as  you  can  the  enclosed  slips  in  an  order  according 
to  the  following  instructions. 

' '  Each  slip  contains  two  trade-marks  of  a  common  article.  The  upper  is  the 
original  trade-mark  and  the  lower  is  the  imitation  of  it. 

"The  different  pairs  of  trade-marks  on  the  different  slips  vary  in  their 
likelihood  of  confusion,  or  in  their  deceptive  similarity,  or  in  the  probability  that 
the  imitation  trade-mark  will  be  mistaken  for  the  original.  This  confusion  may 
be  due  to  the  appearance  of  the  trade-marks,  their  sound,  their  linguistic  forma- 
tion, their  meaning  or  significance,  or  any  combination  of  these  four. 

"Arrange  the  slips  serially  according  to  their  likelihood  of  confusion  as 
follows:  Put  on  the  top  of  the  pile  the  slip  whose  trade-marks  show  the  greatest 
likelihood  of  confusion  and  on  the  bottom  the  slip  whose  trade-marks  show  the 
least  likelihood  of  confusion.  Between  the  top  slip  and  the  bottom  slip  put  those 
stipe  whose  trade-marks  show  intervening  degrees  of  likelihood  of  confusion. 

"In  arranging  the  slips  consider  the  trade-mark  as  if  you  have  had  no 
previous  experience  with  it." 

Forty  college  students,  20  men  and  20  women,  acted  as  judges. 
They  were  students  of  psychology  at  Columbia  University  in  the 
spring  of  1915.  Their  ages  were  fairly  uniform,  varying  only 
within  a  few  years  of  each  other. 

At  the  hands  of  Fechner,  Galton,  Cattell,  Thorndike,  Holling- 
worth,  Strong,  and  others  the  relative  position  method  has  yielded 
various  scientific  and  practical  investigations  of  great  importance.8 

*  For  a  more  complete  account  of  the  technique  of  measurements  by  relative 
position  and  of  mental  scales  see  E.  L.  Thorndike,  ' '  Mental  and  Social  Measure- 
Bests,"  1913,  7-26;  B.  8.  Woodworth,  mimeographed  lecture  notes  on  Judgment, 
1917,  3-6,  16-20;  and  H.  L.  Hollingworth,  The  Method  of  Relative  Position, 
"Psychological  Researches  of  J.  McK.  Cattell,"  Archives  of  Psychol,  1914,  No. 
30,  75-91. 


CHAPTER  JII 

RESULTS  OP  THE  RECOGNITION  EXPERIMENTS 

1.  Average  Results 

The  first  section  of  this  chapter  deals  mainly  with  the  psycho- 
logical aspect  of  recognition,  and  the  following  sections  with  the 
practical  side.  We  shall  begin  by  examining  the  extent  to  which  the 
imitations  were  confused  when  the  observers  were  not  told  about 
them.  It  will  be  remembered  that  in  each  test  there  appeared  10 
imitations,  the  originals  having  previously  appeared  in  the  presenta- 
tion. Tho  the  imitative  trade-mark  itself  was  in  every  instance 
different  from  the  original  trade-mark,  the  name  of  the  commodity 
was  identical  in  both  connections.  In  the  Uninformed  experiment 
a  recognition  of  an  imitation  is  scored  correct  if  it  is  discriminated 
and  placed  in  one  of  the  "not  seen"  piles;  in  the  Informed  experi- 
ment it  is  scored  correct  if  placed  in  one  of  the  "changed"  piles. 
In  the  Uninformed  experiment  an  imitation  is  scored  incorrect  if 
identified  and  placed  in  one  of  the  "seen"  piles.1  This  score  repre- 
sents the  percentage  of  confusion  (or  mistaken  recognitions)  between 
the  originals  and  the  imitations.  In  the  Informed  experiment  an 
imitation  is  scored  incorrect  if  it  is  discriminated  and  placed  in  one 
of  the  "new"  piles,  or  if  identified  and  placed  in  one  of  the  "iden- 
tical" piles.  The  identifications  represent  the  percentage  of  con- 
fusion between  the  originals  and  the  imitations.  Then  the  "seen" 
pile  in  the  Uninformed  and  the  "identical"  in  the  Informed  are 
comparable  in  respect  to  confusion. 

TABLE   I. 

Thx  Average  Per  Cent,  and  Probable  Error  of  Incorrect  Identifications  of 

the  Imitative  Trade-Marks 
Uninformed  Subjects 

Trademarks  Av.  PerfCent. 

Number  Kind  Confused  P.  E. 

60  Imitative  44  1JS 

i  The  discriminations  in  the  Uninformed  group  represents  three  kinds  of 
recognitions,  (1)  the  imitations  recognized  as  somewhat  altered  or  changed,  (2) 
a  recognition  of  no  similarity  or  difference  in  the  imitation,  and  (3)  the  imitation 
recognized  as  entirely  new,  the  original  having  been  forgotten.  In  the  Informed 
the  discriminations  represent  only  the  two  latter  kinds  of  recognitions.  In  the 
results,  however,  these  are  all  massed  together. 

U 


RESULTS  OF  THE  RECOGNITION  EXPEEIMENTS  35 

f 

(a)  Uninformed  Experiment. — Table  I.  presents  the  results  of 
the  imitative  trade-marks  in  the  case  of  the  Uninformed  group  of 
subjects.  The  first  column  in  the  table  states  the  number  of  trade- 
marks studied,  and  the  second  the  kind  of  trade-mark,  i.  e.,  whether 
imitative,  duplicate,  or  new.  The  third  column  shows  the  average 
per  cent,  of  incorrect  identifications  or  the  average  per  cent,  of  times 
the  imitative  trade-marks  were  confused  with  their  respective 
originals.  The  fourth  column  gives  the  probable  error  of  the 
average.  \ 

Forty-four  per  cent,  of  the  imitative  trade-marks  were  incorrectly 
identified,  t.  e.,  were  indicated  as  having  been  seen  before  in  the 
presentation.    The  probable  error  of  this  average,  44  per  cent.,  is 
1.5,  the  chances  being  even  that  the  true  average  (obtained  from  an 
infinite  number  of  subjects)  lies  between  42.5  and  45.5,  or  outside 
it.     The  average  of  44  per  cent,  has  then  a  high  degree  of  validity. 
If  all  the  imitative  trade-marks  had  been  discriminated  by  every 
subject,  or  indicated  as  not  having  been  seen  before,  all  the  recogni- 
tions would  have  been  scored  correct  and  the  average  per  cent,  of  in- 
correct identifications  would  have  been  0.    But  if,  on  the  other 
hand,  all  the  imitations  had  been  confused  with  their  respective 
originals,  the  average  per  cent,  of  incorrect  identifications  would 
have  been  100.    The  difference  between  44  per  cent,  and  the  greatest 
possible  score  of  confusion  100  per  cent,  gives  56  per  cent.,  the  aver- 
age   -per  cent,  of  correct  discriminations.    The  average  per  cent.  56 
is  12  per  cent,  or  about  1.3  times  greater  than  the  average  per  cent. 
44  of  incorrect  identifications.    In  other  words  there  are  about  one 
foarth  more  imitations  correctly  discriminated  than  confused. 

Ture  chance,  involving  no  question  of  memory  at  all,  would  give 
aboxit  50  per  cent,  correct  and  50  per  cent,  incorrect  recognitions. 
AlrfcJno  the  percentages  of  correct  and  incorrect  recognitions  of  Table 
I.    are  6  per  cent,  away  from  what  pure  chance  would  give,  they 
shoxild  not  be  considered  as  influenced  by  chance  to  this  large  extent. 
That  this  is  discredited  is  apparent  from  an  examination  of  the 
individual  scores  of  the  imitative  trade-marks;2  those  possessing 
greater  similarity  in  form  and  meaning  receiving  higher  scores  0? 
confusion,  and  vice  versa.    If  chance  were  so  greatly  active  in  pro- 
ducing the  average  44  per  cent.,  the  imitative  trade-marks  of  high 
suxlUarity  would  have  about  an  equal  number  of  high  and  low  scores 
°f  confusion.    The  data  from  the  duplicate  and  new  trade-marks 
'Wonld  likewise  be  affected  so  as  to  result  in  scores  close  to  50  per 
cent,  correct  and  50  per  cent,  incorrect  recognitions.    On  the  con- 

*  840  Table  IV.,  pp.  30-41. 
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gives  the  average  per  cent.  (26)  of  incorrect  discriminations,  i.  e.,  of 
the  failure  to  recognize  the  imitations  as  resembling  some  trade- 
marks seen  in  the  previous  presentation.  The  average  per  cent.  (51) 
of  correct  recognitions  of  change  is  about  2.2  times  greater  than  the 
average  per  cent.  (23)  of  incorrect  identifications,  and  about  2.0  times 
greater  than  the  average  per  cent.  (26)  of  incorrect  discriminations, 
which  is  about  1.1  times  greater  than  the  average  per  cent,  of  in- 
correct identifications.    The  last  difference  is  not  large. 

It  might  well  be  asked  now  which  is  the  more  typical  method  in 
everyday  life  and  which  is  the  better  psychologically,  the  Unin- 
formed or  the  Informed.    In  everyday  life  we  find  each  of  these 
methods  and  a  combination  of  the  two;  the  corresponding  kinds  of 
recognition  described  under  our  experimental  conditions  also  occur- 
ring.   The  Informed  method  is  perhaps  from  the  psychological  point 
of  view  the  better,  as  it  gives  us  more  information  concerning  the 
subject's  performance  than  the  Uninformed.    A  court  of  equity 
'Would  most  likely  favor  an  experiment  conducted  under  the  Unin- 
formed conditions,  as  it  generally  considers  that  the  ordinary  pur- 
chaser in  daily  life  to  be  similarly  unwary. 

table  m 

Thx  Average  Per  Gent,  and  Probable  Error  or  Correct  Identifications  or 

the  Original  Trade-Marks 

Control  Subjects 


Tnde- Marks 

Av.  Per  Cent,  of  Correct 

Number 

Kind 

Identifications 

P.  E. 

60 

Original 

84 

S 

(c)  Control  Experiment. — Whether  there  is  or  is  not  confusion 
in  the  preceding  recognition  experiments  depends  upon  two  factors, 
the  degree  of  deceptive  similarity  of  the  imitation  and  the  memory 
of  the  original.  At  first  it  was  thought  that  by  determining  the 
recognitive  value  of  the  originals  it  would  be  possible  to  assign  an 
exact  value  to  each  of  these  factors.  It  was  seen  later,  however, 
that  such  an  analysis  could  not  be  made.  The  Control  experiment 
was  not  in  fact  a  control,  for  we  did  not  keep  the  deceptive  simi- 
larity constant  while  measuring  at  the  same  time  the  memory  of  the 


it  may  represent  a  noting  of  incorrect  changes  in  the  imitation,  as  a  result 
of  an  incorrect  recalling  of  the  original,  an  incorrect  comparison  of  the  imitation 
and  the  original,  or  both.  The  recognitions  of  change  described  in  the  above 
eases  with  the  numerous  possible  variations  give  one  an  idea  of  the  different  de- 
grees of  accuracy.  The  data  at  hand  do  not  enable  one,  however,  to  fligtfngni«l» 
those  degress,  The  recognitions  are  still  more  complicated  by  the  role  played  by 
the  same  of  the  article  in  aiding  or  thwarting  recognition. 
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principles  and  assumptions  in  regard  to  imitations  has  surely  a 
detrimental  effect  not  only  on  their  own  proceedings  but  also  on 
business  and  commerce.    Confusion,  tho  it  be  a  subjective  fact,  is 
also  a  quantitative  one.    To  handle  it  correctly  it  needs  to  be  meas- 
ured, not  merely  defined.    In  ordinary  conversation  we  are  usually 
satisfied  in  remarking  that  the  weather  is  hot,  warm,  cool,  etc.    But 
in  scientific  and  industrial  laboratories  these  adjectives  become  ex- 
ceedingly vague  and  are  replaced  by  degrees  on  the  thermometer. 
By  standardizing  our  notions  about  degrees  of  heat,  the  thermometer 
permits  of  greater  accuracy  in  working  with  them.     Clear  and 
quantitative  meanings  attached  to  the  legal  and  illegal  categories  of 
deception  would  undoubtedly  favor  greater  accuracy  in  handling 
them  too. 

Let  us  now  see  what  the  highest  and  lowest  scores  are  for  each 
kind  of  recognition.    In  the  Uninformed  "Nubia-Nubias"  is  the 
most  confusing  pair  of  trade-marks,  deceiving  17  out  of  20  indi- 
viudals  or  85  per  cent,  of  the  group.    The  least  confusing  pair  is 
" Welcome — Welcome  A.  Smith"  with  a  score  of  5  per  cent,  deceiv- 
ing only  1  out  of  20  individuals.    Column  7  shows  that  in  the 
Informed  group  seven  pairs  of  trade-marks  have  0  per  cent,  scores 
of  confusion.    In  the  Uninformed  one  of  these,  "Welcome — Wel- 
come A.  Smith,"  has  5  per  cent,  of  confusion  and  another,  "Wil- 
Jonghby  Lake — Willoughby  Badge, ' '  has  70  per  cent.    For  the  0  per 
<*nt.  scores  in  the  Informed  this  is  the  largest  difference  between  the 
confusion  of  any  two  in  the  Uninformed.    "  Johnston  > — John- 
son's" with  75  per  cent,  of  confusion  is  the  most  confusing  imita- 
tion in  the  Informed,  it  being  eighth  from  the  top  in  the  Uninformed 
*here  its  score  is  65  per  cent.    This  pair  of  trade-marks  is  one  of 
fte  three  which  received  a  higher  score  of  confusion  in  the  Informed 
than  in  the  Uninformed;  these  being  the  only  cases  where  the 
natural  results  of  more  confusion  in  the  Uninformed  than  in  the 
Informed  does  not  obtain.    As  the  difference  is  not  large  in  any  of 
the  three  cases  it  is  quite  possible  that  further  experimentation  would 
reverse  the  advantage.    It  will  be  noticed  that  the  scores  of  con- 
fusion in  the  Informed  tend  in  general  to  increase  with  their  cor- 
responding ones  in  the  Uninformed.    In  52  cases  out  of  60  the  con- 
fusion in  the  Uninformed  is  higher  than  in  the  Informed;  and  in  5 
cases  they  are  equal. 

In  the  column  for  correct  recognitions  of  change  "Walkeasy — 
Wjulkwell"  has  a  100  per  cent,  or  perfect  score,  and  "Trenton — 
Trenton  Style"  with  10  per  cent,  stands  at  the  lower  limit.  The 
former  in  the  Uninformed  confused  10  per  cent.,  and  in  the  In- 
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plication.  They  have  been  treated  from  various  aspects  by  many 
psychologists.  Galton,  Cattell,  Binet  and  Simon,  Terman,  Thorn- 
dike,  Yerkes,  and  others  have  done  much  to  place  the  subject  on  a 
scientific  basis.  There  are  now  at  least  29  mental  scales  in  use, 
measuring  such  things  as  English,  reading,  spelling,  handwriting, 
drawing,  mathematics,  teachers'  efficiency,  intelligence,  and  emi- 
nence. The  chief  value  of  these  scales  lies  in  their  possessing  greater 
accuracy  in  measuring  mental  traits  than  the  more  usual  and  more 
subjective  methods.5  A  psychological  scale  for  the  measurement 
of  the  amount  of  deceptive  similarity  between  two  trade-marks  would 
also  be  a  more  accurate  method  for  the  determination  of  lawful 
and  unlawful  imitations  than  the  present  judicial  procedure,  but 
such  a  scale  has  not  yet  been  made.  Even  if  it  were,  it  is  likely  that 
slowly  progressive  judicial  opinion  would  not  be  quite  ready  to 
accept  it.  Nevertheless,  it  might  be  worth  while  to  show  by  an 
example  the  manner  of  construction  and  the  mode  of  application  of 
such  a  scale. 

SCALE  I 


SCALE  Or   VISUAL  h 

XC0GK1T1VS  CONFUSION  OF  TR 

ADB-MABK8 

Confusion 

Originate 

Imitation* 

Order       P.  C. 

Welcome 

Welcome  A.  Smith 

1             5 

Golden  Charm 

Charm 

2        10 

Yoeea 

TJ-C-A 

3        20 

Royal  Irish  Linen 

Boyal  Vellum 

4        30 

Reata-AU 

Knoxall 

5        35 

Shipmate 

Messmate 

6        40 

Six  little 

Six  Big 

7        45 

Carbolineum 

Creo-Carbolin 

8        50 

Mormaja 

Mojava 

9        55 

Grenadine 

Grenade 

10        60 

Mnreseo 

Murafresco 

11        65 

Cottolene 

Cottoleo 

12        70 

Dyspepticure 

Dyspepticide 

13        75 

Siphon 

Siphon  System 

14        80 

Nubia 

Nubias 

15        85 

Professor  Woodworth  has  said  that  "an  order  series  assumes  to 
some  degree  the  character  of  a  graduated  scale. '  '*  The  sample  scale 
may  then  be  derived  from  Table  IV.    Scale  I.  contains  15  pairs  of 

•  For  farther  information  concerning  the  aims  and  scope  of  mental  tests  con- 
salt,  "Report  of  the  Committee  on  the  Academic  Status  of  Psychology;  A  Sur- 
wtj  of  Psychological  Investigations  with  Reference  to  Differentiations  between 
r^mknlofU  ■!  Experiments  and  Mental  Tests,"  Amer.  Psychol,  Assn.,  December, 
ItM. 

•  Of.  0<&,p.  4. 
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gradings  thus  obtained,  it  may  be  determined  whether  the  imitation 
is  an  infringement  or  a  non-infringement,  according  as  the  amount 
of  confusion  lies  above  or  below  the  limit  of  infringement.    The 
second  method  may  require  less  time  than  the  first,  but  as  the  rating 
is  less  objective  than  the  recognition  procedure  and  different  from 
the  actual  conditions  giving  the  scale,  it  may  not  be  as  accurate. 
Both  methods  are,  however,  much  superior  to  the  judicial  procedure. 
A  psychological  scale  of  confusion  for  measuring  the  deceptive 
similarity  between  trade-marks  is  more  complicated  than  would  at 
first  be  supposed.    In  the  first  place  the  scale  should  be  made  up  of 
pairs  of  word  trade-marks  that  were  litigated  in  the  highest  courts. 
Some  should  be  infringements  and  some  non-infringements.    It  is 
important  that  they  should  be  selected  from  only  simple  cases  in 
which  the  decision  of  infringement  or  non-infringement  clearly  ap- 
pears to  be  colored  by  nothing  else  than  the  likelihood  of  confusion 
of  just  the  two  word  trade-marks.    More  complicated  cases  in  which 
other  points  aided  in  deciding  this  question  should  not  be  included. 
The  pairs  of  trade-marks  from  the  simple  cases  represent  then  de- 
cisions that  are  both  legally  and  psychologically  homogeneous. 

The  recognition  method  with  the  subjects  uninformed  would 
fulfill  best  the  legal  and  psychological  requirements.    It  is  better 
to  experiment  with  the  trade-marks  alone,  not  in  connection  with  the 
names  of  their  articles.    The  addition  of  the  latter  in  the  experiment 
changes  not  only  the  absolute  but  also  the  relative  amounts  of  con- 
fusion of  the  trade-marks.    Many  more  degrees  of  confusion  should 
be  included  in  the  scale  and  should  spread  over  the  whole  range, 
«-  g.,  from  0  per  cent,  to  100  per  cent,  of  confusion.    The  difference 
between  the  degrees  should  be  equal  or  very  nearly  so.    The  subjects 
should  come  from  many  walks  of  life.    Several  hundred  subjects 
should  at  least  be  tested.    The  questions  of  infringement  and  non- 
infringement must  be  fixed  in  terms  of  amounts  of  confusion.    This 
may  be  done  in  two  ways.    According  to  the  one  the  legislature  or 
the  courts  may  decide  these  amounts  under  certain  experimental 
conditions.     Either  a  point  or  a  space  on  the  scale  may  divide  the 
legal  from  the  illegal  amounts  of  confusion.    According  to  the  other 
the  standards  of  infringement  and  non-infringement  may  be  fixed 
by  two  averages  with  their  probable  errors,  one  representing  the 
average  amount  of  confusion  of  a  number  of  infringements,  and 
the  other  of  a  number  of  non-infringements.    Those  trade-marks 
composing  the  scale  should  be  so  selected  after  experimentation 
that  only  infringements  should  lie  in  the  illegal  and  non-infringe- 
ments in  the  legal  limits. 
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The  proposal  to  give  a  precise  meaning  to  the  term  infringement 
would  be  likely  to  meet  with  opposition.  In  his  chapter  on  Infringe- 
ment Hopkins  writes  :8 

"In  conclusion  it  is  important  to  bear  in  mind  that  courts  of  equity  have 
always  avoided  laying  down  any  hard  and  fast  rules  by  which  to  determine  what 
constitutes  fraud.  The  reason  for  this  absence  of  set  rules  has  been  well  stated 
as  follows:  "Were  courts  of  equity  to  once  declare  rules  prescribing  limitations 
with  their  power  of  dealing  with  it,  the  jurisdiction  would  be  perpetually 
cramped  and  eluded  by  new  schemes  which  the  fertility  of  man  'a  invention  would 
contrive. '  '• 

It  would  certainly  be  imprudent  to  ignore  this  legal  maxim,  but 
it  would  be  even  more  so  not  to  see  how  the  psychological  methods 
do  actually  work. 

The  scale  we  have  constructed  on  the  basis  of  confusion  is  not 
an  absolute  scale,  i.  e.,  it  does  not  start  from  zero  or  "just  not  any 
of"  confusion.  In  this  respect  it  is  inferior  to  the  scales  in  the 
physical  sciences.    The  advantage  in  having  an  absolute  scale  lies  in 

being  able  to  make  a  "time  as "  comparison.    Four  pounds  is 

twice  as  heavy  as  2  pounds,  and  3  feet  is  one  third  as  long  as  9  feet. 
But  we  cannot  say  that  50  per  cent,  of  confusion  is  twice  as  confus- 
ing as  25  per  cent,  of  confusion,  because  we  do  not  know  that  the 
50  per  cent,  is  twice  as  far  from  0  per  cent,  as  25  per  cent.  is.  Even 
if  the  scale  contained  a  pair  of  trade-marks  which  gave  0  per  cent, 
of  confusion  among  1,000  individuals,  testing  a  few  more  thousand 
individuals  might  show  some  evidence  of  confusion.  However,  just 
a  little  confusion  might  be  due  to  chance.  Other  things  being 
properly  accounted  for,  an  absolute  scale  would  be  preferable,  as  it 
would  be  more  reliable.  The  larger  the  number  of  individuals  that 
the  percentage  scale  of  confusion  represented  the  more  it  would  tend 
to  be  absolute. 

4.  Comparison  of  the  Results  op  the  Originals  and  Imitations 

This  section  treats  of  the  relations  to  each  other  of  the  amounts 
of  the  various  kinds  of  recognition  of  the  originals  and  imitations 
in  the  Uninformed,  Informed,  and  Control  groups.  The  first 
column  in  Table  V.  gives  the  number  of  pairs  of  the  originals  and 
imitative  trade-marks  that  entered  into  the  calculations  of  the  sue 
ceeding  columns.  Column  2  indicates  the  limits  of  the  amounts  o 
confusion  of  the  trade-marks  in  the  Uninformed,  and  column  3  th 

•  " The  Law  of  Trademarks,  Tradenames,  and  Unfair  Competition,"  190 
303. 

•  Weinstock,  Lubin  &  Co.  v.  Marks,  109  Cal.  529-539. 
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difference  between  these  limits.  Column  4  shows  the  average  per 
cent,  of  confusion  in  the  Uninformed,  and  column  5  the  probable 
error  of  the  average.  Column  6  shows  the  average  per  cent,  of 
incorrect  identifications  or  confusions  of  these  trade-marks  in  the 
Informed.  The  remaining  columns  up  to  12  are  self-explanatory. 
Column  12,  however,  gives  the  correct  identifications  of  the  originals 
in  the  Control,  the  imitations  not  figuring  in  this  group.  All  the 
percentages  of  the  preceding  Table  IV.  are  condensed  in  Table  V. 


TABLE  v 

The  Bkognition  8ooris  and  thxib  Probable  Errors  in  the  Uninformed,  the 
Informed  and  the  Control  Groups  for  Different  Trade-Marks 
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The  first  row  of  figures  reads  as  follows:  The  first  9  pairs  of 
trade-marks  or  the  lowest  9  in  the  percentage  of  confusion  in  the 
Uninformed  range  in  percentage  of  confusion  from  5  per  cent,  to  20 
per  cent.,  a  difference  of  15  per  cent.;  the  average  percentage  of 
confusion  of  these  trade-marks  is  14  with  a  probable  error  of  1.5. 
In  the  Informed  group  the  average  percentage  of  confusion  for  these 
same  9  pairs  of  trade-marks  is  6  with  a  probable  error  of  1.5  etc. 
The  second  row  gives  the  average  results  of  the  next  16  pairs  of 
trade-marks  of  higher  confusion  in  Table  IV. 

Column  4  and  6  show  that  an  increase  of  confusion  in  the  Unin- 
formed is  accomplished  with  an  increase  of  confusion  in  the  In- 
formed, with  the  exception  of  the  two  highest  degrees  in  the  In- 
formed; along  the  entire  range  confusion  in  the  Informed  is  on  an 
average  about  one  half  that  in  the  Uninformed.  The  widest  de- 
parture from  this  is  with  the  trade-marks  of  the  highest  degree  of 

i*  The  differences  in  this  column  could  have  been  made  equal  instead  of  un- 
equal had  there  been  a  sufficient  number  of  trade-marks  to  give  reliable  averages 
stewjstep. 
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per  cent,  higher  than  the  average  per  cent.  (74)  of  correct  identifica- 
tions of  the  originals  in  row  2.  Tho  the  difference  is  covered  by  the 
probable  errors  it  is  seen  that  some  imitations  on  the  average  re- 
semble their  originals  as  much  as  some  originals  are  identified  with 
themselves. 

5.  Introspective  Notes 

At  the  close  of  the  experiment  the  following  question  was  put  to 
each  observer.  "How  did  you  react  when  the  words  were  shown  to 
you  in  the  presentation  and  in  the  test?"  The  observers  stated  gen- 
erally that  in  the  presentation  they  had  time  to  do  no  more  than  read 
the  words.  Some,  however,  articulated  the  words  and  others  made 
associations  with  them.  In  the  Informed  experiment  one  observer 
made  associations  with  the  initial  letters,  another  noted  particularly 
the  ends  of  the  words,  and  in  several  cases  imagery  was  noted  as 
being  present  in  the  presentation  and  test.  A  few  observers  articu- 
lated also  in  the  test.  The  observers  in  the  Uninformed  experi- 
ment often  made  casual  remarks  while  making  their  recognitions  in 
the  test,  and  so  gave  voluntary  and  uncalled  for  introspections  about 
the  effects  of  the  imitations  on  them.  Many  said  that  there  were 
not  the  same  number  of  slips  in  the  test  as  in  the  presentation.  One 
said,  "I  notice  slight  changes;"  a  second,  "Some  names  are  mixed 
up;"  a  third,  "Do  you  have  the  same  product  with  different  trade- 
marks;" and  a  fourth,  "Do  you  mean  exactly  the  same?"  Still 
another  said,  "I  saw  'Six  Little  Tailors'  the  first  time,  but  this  is 
'Six  Big  Tailors,'  are  they  meant  to  be  the  same  or  did  you  make 
a  mistake?"  Sometimes  before  recognizing  an  imitation  it  would 
be  set  aside  to  see  whether  its  supposed  original  would  turn  up  later. 
In  a  few  cases  when  the  observer  became  convinced  of  the  presence 
of  the  imitations,  he  stated  that  in  the  beginning  of  the  experiment 
an  imitation  was  incorrectly  identified. 

While  some  were  apparently  in  doubt  as  to  the  presence  of  the 
imitations  and  before  they  had  decided  upon  it,  I  often  caught 
them  trying  to  read  the  answer  from  my  facial  expression  or  looking 
there  for  a  clue.  Furthermore,  some  of  the  observers  gave  clear 
indication  by  their  curt  expressions  and  behavior  that  they  had 
noticed  a  trick  in  the  imitations.  Altho  some  became  aware  of  the 
imitations  after  the  first  one  met,  others  were  not  conscious  that 
there  had  been  imitations  present  even  at  the  end  of  the  experiment. 
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6.  Summary 

1.  When  the  individuals  are  unaware  of  the  presence  of  imita- 
tions they  confuse  on  the  average  44  per  cent,  of  the  imitations  with 
the  originals,  and  correctly  discriminate  56  per  cent. 

2.  When  the  individuals  are  aware  of  the  presence  of  imitations 
they  confuse  on  the  average  23  per  cent,  of  the  imitations  with  the 
originals,  correctly  discriminate  51  per  cent.,  and  fail  to  recognize 
26  per  cent,  of  the  imitations  as  resembling  the  originals. 

3.  The  correct  identifications  of  the  duplicates  of  tjie  originals 
are  about  5.3  times  as  numerous  as  the  incorrect  discriminations/ 

4.  Every  imitation,  non-infringements  as  well  as  infringements, 
cause  some  confusion  among  the  individuals  unaware  of  their 
presence. 

5.  The  scores  of  confusion  of  the  imitations  do  not  divide  into 
two  distinct  groups,  those  likely  to  deceive  and  those  not  likely  to 
deceive,  but  their  distribution  forms  a  continuum.  The  findings  in 
the  last  two  statements  discredit  the  present  legal  treatment  of 
imitations. 

6.  The  construction  and  application  of  a  psychological  scale  for 
the  measurement  of  deceptive  similarity  of  two  trade-marks  would 
be  the  most  scientific  method  of  determining  the  question  of  in- 
fringement. 

7.  The  lower  the  degree  of  deceptive  similarity  of  two  trade- 
marks the  less  is  the  confusion  and  the  greater  is  the  ability  to 
recognize  the  change. 

8.  The  originals  that  are  most  often  displayed  by  their  imitations 
are  just  as  well  identified  as  those  that  are  least  often  displaced. 

9.  The  individuals  who  were  aware  of  the  presence  of  the  imita- 
tions at  the  beginning  of  the  experiment  were  affected  in  a  variety 
of  ways  by  them.  Some  noted  their  presence  after  meeting  a  few, 
and  others  did  not  even  at  the  end  of  the  experiment. 


CHAPTER  IV 

RESULTS  OF  THE  RELATIVE  P08ITION  EXPEBIMENT 

1.  Results  fob  the  Separate  Trade-Marks 

Ik  this  experiment  a  number  of  individuals  judged  the  decep- 
tive similarity  between  the  trade-marks  with  the  object  of  ascertain- 
ing the  relative  differences,  not  the  exact  amount  of  confusion. 
"The  ability  to  perceive  degrees  of  difference  and  to  arrange  objects 
in  an  ordered  series,' '  Professor  Wood  worth  writes,1  "is  a  funda- 
mental and  significant  fact  in  psychology."  While  an  individual 
may  be  unable  to  state  the  correct  reasons  for  his  judgments  or  to 
completely  analyze  the  similarities  and  differences  between  the 
trade-marks,  yet  his  judgments  are  significant.  In  the  words  of 
William  James:  "In  ethical,  psychological,  and  esthetic  matters,  to 
give  a  clear  reason  for  one's  judgment  is  universally  recognized  as 
a  mark  of  rare  genius."3  The  single  judgment  of  any  individual 
is  a  subjective  and  variable  fact,  so  that  an  individual's  judgment 
may  not  be  the  same  at  one  time  as  at  the  next  time,  nor  like  that 
of  his  neighbor's.  In  order  therefore  to  obtain  reliable  results  in 
our  experiments  the  relative  position  of  each  pair  of  trade-marks 
is  determined  by  the  average  of  the  independent  gradings  by  50 
individuals.  In  carrying  out  this  experiment  the  test  material  is 
not  presented  to  the  subject  in  the  same  manner  as  in  the  recogni- 
tion experiments.  In  the  two  kinds  of  experiments  some  of  the 
mental  processes  involved,  and  the  reactions  of  the  subject,  are  dif- 
ferent. But  for  all  that  there  are  certain  resemblances  in  the  mental 
processes,  for  recognition  implies  some  judgment,  and  judgment  im- 
plies some  recognition.8  We  must  not  now,  however,  dwell  on  this 
subject  for  our  interest  lies  chiefly  with  the  objective  results  and 
their  comparison,  rather  than  on  the  psychological  principles  under- 
lying the  methods. 

Table  VJ.  presents  the  relative  degrees  of  confusion  of  the  trade- 
marks in  the  relative  position  experiment  and  the  scores  correspond- 
ing to  them  in  the  recognition  experiments.  The  fifth,  sixth,  and 
seventh  columns  give  the  results  of  the  former.    The  fifth  gives  the 

»  Op.  <**.,  p.  3. 

'"Priaei^les  of  Phenology,"  1890,  II.,  365. 

»  B.  8.  Woodworth,  mimeographed  lecture  notes  on  Perception,  1917,  p.  1. 
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order  of  confusion  from  least  to  most  as  determined  by  the  average 
grades,  the  sixth  gives  the  average  grade  of  confusion,  and  the 
seventh  the  probable  error  of  the  grade.    Columns  8-12  give  the 
results  of  these  trade-marks  in  the  recognition  experiments.    Where 
the  grades  are  equal  their  order  is  determined  by  the  amounts  of 
confusion  in  recognition.    When  they  are  arranged  in  an  ordered 
series  two  pairs  of  trade-marks  may  differ  slightly  or  greatly  in 
confusion.    The  grades  and  their  probable  errors  indicate  such  in- 
equalities in  the  spacing  of  the  series.    When  the  grades  of  two 
pairs   of  trade-marks  differ  little,   we   may   conclude   that   their 
amounts  of  confusion  really  differ  little,   and  vice  versa.     The 
variability  of  the  grade  as  shown  by  the  probable  error  permits  us 
to  draw  a  similar  conclusion.    The  probable  error  of  a  measure 
states  the  unreliability  of  the  measure,  or  the  probable  approxima- 
tion of  the  true  measure  (calculated  from  an  infinite  number  of 
cases)  to  the  obtained  measure  (calculated  from  50  cases  in  this 
experiment).    The  probable  error  of  the  average  shows  within  what 
limits  the  chances  are  even  that  the  obtained  average  is  correct 
The  probable  error  0.25  of  the  grade  5.0  of  "Shipmate — Messmate" 
indicates  that  the  chances  are  even  that  the  true  average  lies  between 
4.75  and  5.25,  or  outside  it.    The  chances  of  true  average  being 
far  outside  this  range  decreases  very  rapidly.    When  the  probable 
error  is  large,  the  true  position  of  the  pair  of  trade-marks  is  not  well 
established,  the  reason  for  this  probably  being  the  small  difference 
in  confusion  between  this  pair  of  trade-marks  and  those  adjacent  to 
it  in  the  series.    For  a  small  difference  is  more  likely  to  be  mis- 
judged than  a  large  difference.    Thus  the  larger  probable  errors 
indicate  that  the  order  is  less  certain,  and  the  difference  between 
one  pair  of  trade-marks  and  the  next  on  the  list  is  less.    The  prob- 
able errors  in  Table  VI.  are  generally  small  showing  that  the  order 
is  well  established.    Ordinary  arithmetic  does  not  apply  to  measures 
by  relative  position.    We  cannot  say  that  grade  7.0  is  twice  as  high 
as  grade  3.5,  or  that  the  second  grade  from  the  highest  plus  the  fifth 
is  equal  to  the  third  plus  the  fourth. 

Glancing  down  columns  6,  8,  and  9  it  will  be  observed  that  in 
general  the  higher  grades  have  the  higher  scores  of  recognitive  con- 
fusion, tho  the  correspondence  between  the  3  orders  is  not  exact 
Every  pair  of  trade-marks,  dissimilar,  random,  and  litigated  re- 
ceived some  rating  of  confusion.  The  grades  do  not  divide  into 
two  separate  groups,  suggesting  those  likely  to  cause  confusion  and 
those  not  likely  to  cause  confusion ;  their  distribution  forms  a  con- 
tinuum, as  in  the  case  of  the  confusion  scores.    The  grades  ot  tta 
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artificial  mating  is  the  random  one,  "White  Bock — Stonetex"  with 
the  grade  of  1.0.  Even  a  glance  at  the  dissimilar  and  random 
matingB  shows  that  "White  Bock — Stonetex"  has  quite  markedly 
more  deceptive  similarity  than  the  others.  It  is  1.0  lower  than 
"  Holeproof — Knotair"  the  lowest  litigated  pair. 

It  has  already  been  pointed  out  that  the  mental  processes  of  the 
observer  recognizing  an  imitation  are  substantially  similar  to  those 
of  a  purchaser  presented  with  an  imitation  in  daily  life.  Likewise, 
the  mental  processes  of  an  observer  judging  and  grading  trade- 
marks in  the  relative  position  experiment  bear  a  certain  resemblance 
to  those  of  a  judge  deciding  the  question  of  infringement  of  trade- 
marks in  a  case  at  the  bar.  A  comparison  of  the  mental  processes 
of  the  observer  and  of  the  judge  will  show  the  superiority  of  the 
experimental  procedure  over  the  legal. 

When  the  court  has  to  decide  on  the  question  of  confusion  be- 
tween two  word  trade-marks  its  judgment  is  usually  based  on  the 
basis  of  three  sources  of  facts.  It  hears  the  briefs  of  the  lawyers  for 
and  against;  it  decides  whether  there  is  any  likelihood  of  confusion 
between  the  trade-marks;  and  it  considers  how  these  new  marks 
compare  with  previously  litigated  infringements  and  non-infringe- 
ments. The  judge  in  the  last  performance  is  doing  something 
similar  to  that  which  the  observer  in  the  experiment  is  doing.  But 
the  judge  has  only  two  categories  in  which  to  register  his  judgment, 
namely:  those  that  are  likely  to  cause  confusion  and  those  not  likely 
to  cause  confusion;  the  observer  has  11.  Consequently  the  judg- 
ments made  by  the  latter  are  much  finer.  When  as  a  result  of  an 
error  a  trade-mark  is  assigned  to  the  wrong  category  by  a  judge, 
the  error  is  large  and  significant ;  in  the  experiment  the  finer  grading 
reduces  it  greatly.  Strictly  the  legal  category  "not  likely  to  cause 
confusion"  would  be  located  on  our  scale  at  or  near  grade  0;  and 
the  legal  category  "likely  to  cause  confusion"  anywhere  from  grade 
0  to  and  inclusive  of  grade  10.  The  fact  that  the  legal  categories 
are  ill-defined  and  without  quantitative  significance  cause  them  to 
be  variously  interpreted  by  different  judges.  Hence,  the  incon- 
sistency of  many  legal  decisions  is  partly  accounted  for. 

The  experiment  is  mathematically  more  valid  or  accurate  than  the 
court  in  that  its  results  are  determined  by  a  larger  number  of  indi- 
viduals, whereas  the  basis  of  the  decision  is  the  opinions  of  only  a 
few  judges.  Inasmuch  as  the  experiment  employs  a  far  greater 
number  of  observers  it  necessarily  yields  results  that  are  much  less 
likely  to  be  the  outcome  of  the  chance  bias  of  a  few  individuals. 
In  the  average  of  a  large  number  of  judgments  chance  bias  ia 
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the  original  with  the  omission  of  one  internal  consonant.  In 
"Capital — Capitol"  the  imitation  is  the  same  as  the  original  with 
the  exception  that  one  internal  vowel  is  replaced  by  another,  the 
imitation  being  similar  in  sound  and  related  in  meaning.  In 
"Nubia — Nubias"  the  imitations  makes  the  original  plural  by  the 
addition  of  a  consonant.  In  "German  Sweet — Sweet  German"  the 
imitation  simply  reverses  the  positions  of  the  two  words  in  the  orig- 
inal. In  "Ceresota — Cressota"  the  imitation  reverses  the  position 
of  two  adjacent  internal  letters,  and  a  consonant  (the  same  kind 
as  the  following  one  in  the  original  and  in  the  imitation)  is  sub- 
stituted for  a  vowel  (the  same  kind  as  the  one  of  the  two  reversed 
letters  in  the  imitation,  and  which  is  the  second  letter  preceding  it 
in  the  original) ;  thus  the  imitation  is  one  syllable  shorter  than  the 
original.  The  words  resemble  each  other  in  sound  and  partly  in 
significance.  In  "Magic — Magico"  by  suffixing  a  final  vowel  a 
tyllable  is  added,  the  similarity  in  meaning  being  retained.  In 
"Worth — Our  Worth"  the  imitation  simply  places  a  personal  pro- 
noun before  the  original.  In  "Cottolene — Cottoleo"  the  imitation 
takes  the  first  seven  letters,  and  substitutes  for  the  2  final  letters  a 
vowel,  thereby  adding  another  syllable.  In  "S.  B. — B.  &  S."  the 
two  initials  are  reversed  and  an  ampersand  is  inserted  between 
them.  In  "Uno — Ino"e  the  imitation  substitutes  another  vowel, 
similarity  in  meaning  being  also  suggested.  In  Table  IV.  among  the 
10  most  confusing  pairs  that  are  not  in  Table  VI.  are  the  following, 
In  "Siphon — Siphon  System"  a  word  is  added  after  the  original. 
In  "West  End — East  End"  the  imitation  substitutes  for  the  first 
word  a  word  of  the  opposite  meaning  whicji  is  similar  in  length  and 
somewhat  so  appearance.  In  "Willoughby  Lake — Willoughby 
Ridge"  for  the  second  word  is  substituted  another  similar  in  length, 
belonging  also  to  geographical  terminology. 

It  may  be  seen  from  this  that  a  definite  classification  of  the 
methods  of  imitating  is  not  always  possible,  as  many  imitations  are 
the  results  of  a  number  of  different  devices.  In  "Ceresota— 
Creasota"  for  example,  the  imitation  omits  a  letter,  adds  one,  re- 
verses two,  and  is  one  syllable  shorter  than  the  original.  The  length, 
or  the  number  of  letters,  syllables,  and  words  in  a  trade-mark  is  an 
important  consideration  in  judging  confusion.  Other  things  being 
equal,  a  slight  change  in  a  long  trade-mark  is  more  deceptively  simi- 

•  Tbe  marks  are  generally  pronounced  "You  know — I  know";  but  one  in- 
dividual weU  versed  in  English  etymology,  saw  no  similarity  in  meaning  as  he 
them  "Oo  know — In  know.'1    This  instance  and  the  other  just  noted 
that  similarity  in  meaning  may  be  conveyed  to  one  individual  and  not  to 
r,  according  to  the  pronunciation  of  the  original  and  the  imita&oii. 
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lar  than  in  a  short  one,  and  hence  will  cause  greater  confusion. 
Feingold  wisely  considers  this  a  matter  of  much  importance.1  It 
should  also  be  remembered  that  trade-marks  may  differ  greatly  in 
length,  while  a  part  that  is  unappropriated  by  the  imitation  may  be 
identical  with  an  essential  part  of  the  original. 

To  determine  whether  imitations  are  dangerous  the  following 
principles  are  suggested  by  Tables  IV.  and  VI.  as  a  useful  general 
guide. 

1.  Omissions. — Imitations  differing  from  the  originals  only  by 
omitting  1,  2  or  3  letters,  1  or  2  syllables,  or  1  word. 

2.  Additions. — Imitations  differing  from  the  originals  only  by 
adding  1,  2  or  3  letters,  1  or  2  syllables,  or  1  word. 

3.  Substitutions. — Imitations  differing  from  the  originals  only 
by  substituting  1,  2  or  3  letters,  1  or  2  syllables,  or  1  word  in  the 
same  or  different  positions  in  the  trade-mark. 

4.  Changes  in  Positions. — Imitations  differing  from  the  originals 
only  by  transpositions  or  reversals  of  1,  2  or  3  letters,  1  or  2 
syllables,  or  1  or  2  words. 

Many  imitations  will  have  to  be  examined  in  connection  with 
more  than  one  of  these  statements.  Because  of  the  variety  of  fea- 
tures and  factors  operative  in  some  cases  of  confusion,  the  above 
classification  cannot  be  expected  to  be  as  accurate  as  a  mathematical 
formula.  In  some  cases,  as  may  be  seen  from  Tables  IV.  and  VI., 
they  will  apply;  in  others  they  will  not.  It  should  be  borne  in  mind 
too  that  the  length  of  a  trade-mark  must  be  taken  into  account  in 
connection  with  the  above  principles. 

Finally,  the  names  of  the  commodities  in  Table  IV.  show  roughly 
that  the  trade-marks  most  often  imitated  are  those  of  household 
articles,  then  in  decreasing  order  those  of  foods,  medicines,  cloth- 
ing,— firm  names  and  liquors  in  about  the  same  proportion.  The 
most  reliable  way,  however,  of  finding  which  articles  are  most  fre- 
quently imitated  would  be  to  consult  a  far  greater  number  of  court 
records. 

3.  Scale  op  Relative  Position  Confusion 

The  purpose  of  constructing  a  scale  of  relative  position  con- 
fusion is  the  same  as  that  of  recognitive  confusion,  namely  to  sup- 
plant the  present  judicial  procedure.  The  relative  position  scale, 
tho  it  too  is  not  ready  for  adoption,  should  be  considered  in  con- 
nection with  the  remarks  made  on  Scale  I.  Scale  II.  is  derived  from 
Table  VI.    It  contains  18  pairs  of  trade-marks,  representing  18 

'  Op.  at 
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degrees  of  confusion.  In  view  of  several  circumstances  it  was  not 
'  possible  to  make  the  distances  between  the  steps  equal.  The  smallest 
is  0.3,  the  largest  1.2,  and  the  average  of  all  0.58,  or  nearly  six  tenths 
of  a  step.  Scale  II.  is  superior  to  Scale  I.  in  one  respect ;  the  grade 
of  confusion  being  based  on  the  trade-marks,  not  as  in  Scale  I.  on 
both  the  trade-marks  and  the  name  of  the  article.  When  the  Unin- 
formed subjects  mistook  "Grenade"  for  "Grenadine"  the  appear- 
ance of  the  word  "Syrup"  in  both  connections  tended  to  cause  some 
of  Hie  confusion.  The  application  of  Scale  II.  follows  the  second 
method  described  under  Scale  I. 


SCALE  II 

Scale  or  Belattvk  Position  Confusion  or 

Trade-Masks 

Confusion 

Order           Grade 

P.  E. 

Syphon 

Black  Diamond 

1                 .1 

M 

Everstick 

Herringbone 

2              .7 

an 

White  Bock 

Stonetez 

3            1. 

ai 

Holeproof 

Knotair 

4            2. 

M 

Royal  Irish  Linen 

Royal  Vellum 

5            2.4 

JO 

Rabberaet 

Babber-vule 

6            3.5 

M 

Bests-All 

Knozall 

7            4.1 

St 

Bear  Lithia  Springs 

Great  Bear  Springs 

8            4.5 

M 

Shipmate 

Messmate 

9            5.0 

JS5 

Social  Begister,  Newport 

Newport  Social  Index 

lO            5.5 

JS8 

Pep-Kola 

Pepko 

11             6.2 

J.8 

Dyspeptieure 

Dyspepticide 

12            6.6 

J3 

Uno 

Ino 

13            7.0 

.19 

Magic 

Magico 

14            7.6 

.*a 

German  Sweet 

Sweet  German 

15            8.0 

J4 

Nubia 

Nubias 

16            8.3 

.15 

Capital 

Capitol 

17            8.8 

Jl 

Drinket 

Drinket 

18           10. 

.00 

Let  ns  suppose  that  the  trade-marks  "Syphon — Black  Diamond" 
to  "Royal  Irish  Linen — Royal  Vellum* '  inclusive  are  non-infringe- 
ments, and  all  above  the  latter  infringements.  An  imitation  receiv- 
ing then  a  grade  of  confusion  above  2.4  may  be  imagined  to  be  illegal, 
one  receiving  2.4  or  less  legal.  When  a  new  case  comes  up  the  pair 
of  trade-marks  can  be  compared  with  the  various  steps  on  the  scale. 
A  number  of  individuals  are  asked  to  match  independently  as  closely 
as  possible  the  new  pair  to  one  on  the  scale,  and  rating  it  the  cor- 
responding grade.  From  the  average  grade  of  confusion  thus  ob- 
tained, it  may  be  determined  whether  the  imitation  is  an  infringe- 
ment or  non-infringement.  If  the  average  grade  of  these  ratings  is 
2.4  or  less  the  imitation  is  a  non-infringement,  if  more  an  infringe- 
ment.   If  for  instance  "Holeproof — Knotair"  received  an  wetugfe 
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grade  of  2.0,  it  would  be  a  non-infringement,  and  if  "Our  Country 
— Old  Country"  received  6.5,  it  would  be  an  infringement. 

Separate  scales  devised  on  the  basis  of  each  of  the  three  factors 
contributing  to  confusion  would  be  of  theoretical  and  practical 
interest.  A  comparison  of  the  gradings  of  the  same  trade-marks  in 
the  different  scales  would  tell  the  correlation  between  deceptive  simi- 
larity in  appearance,  similarity,  meaning,  and  all  combined.  The 
practical  importance  of  the  scales  would  lie  in  the  fact  that  the 
trade-marks  could  be  rated  on  the  particular  factors  that  were  the 
cause  of  confusion.  There  are  quite  a  number  of  trade-marks  that 
are  likely  to  be  confused  usually  under  visual  conditions,  or  in 
sound.  By  grading  the  former  on  the  scale  for  visual  confusion, 
and  the  latter  for  auditory  confusion,  more  detailed  information 
is  obtained.  In  determining  the  question  of  infringement  these 
grades  might  also  be  considered  in  connection  with  those  on  the 
scale  of  general  confusion. 

4.  Comparison  op  the  Relative  Position  Resui/ts  with  Those 

op  Recognition 

One  of  the  main  objects  of  this  chapter,  still  to  be  considered, 
is  the  relation  between  confusion  as  determined  by  relative  position 
and  recognition.  Inspection  of  Table  VI.  gives  a  general  impression 
that  there  is  a  positive  correspondence  between  the  two  orders.  By 
working  out  correlations  and  by  epitomizing  these  results  we  may 
obtain,  however,  a  better  impression.  The  latter  is  done  in  Table 
VII.,  by  averaging  in  four  groups  the  relative  position  and  recogni- 
tion scores  of  the  trade-marks  "Holeproof — Knotair"  to  "John- 
ston's— Johnson V  inclusive  in  Table  VI.  Table  VII.  is  formed 
and  reads  like  Table  V.  The  9  trade-marks  in  the  first  row  are 
"Holeproof — Knotair"  with  the  grade  of  2.0  to  and  including 
"Bestyette — Veribest"  with  the  grade  4.4,  etc. 

The  average  grades  of  confusion  run  in  column  4  from  3.5  to 
7.8,  and  in  volume  6  the  corresponding  scores  of  confusion  in  the 
Uninformed  run  from  29  per  cent,  to  55  per  cent,  with  steady  in- 
crease at  each  step.  In  column  8  the  corresponding  scores  of  con- 
fusion in  the  Informed  run  with  quite  a  regular  increase  from  8 
per  cent,  to  36  per  cent.  Column  10,  likewise  in  agreement,  shows 
at  each  step  that  the  higher  the  grade  of  confusion  the  lower  the 
ability  to  recognize  the  change  in  the  imitation.  Column  12  shows 
that  the  incorrect  discriminations  do  not  depend  on  deceptive  simi- 
larity. Column  14  shows  also  that  the  identifications  of  tie  orig- 
inals are  not  related  to  the  degree  of  confusion.    In  other  words,  the 


RESULT 8  OF  TEE  RELATIVE  POSITION  EXPERIMENT  65 

order  as  determined  by  the  recognition  scores  of  confusion  agrees 
with  the  order  by  the  relative  position  grades.  It  will  be  noticed 
that  the  orders  of  the  recognition  scores  of  confusion  and  change 
are  in  somewhat  closer  agreement  with  each  other  and  with  that  of 
the  relative  position  grade  than  with  themselves  in  Table  V.  This 
is  an  indication  that  the  order  established  in  Table  VII.  by  the  rela- 
tive position  grades  is  more  valid  for  relative  differences  than  that 
of  confusion  in  the  Uninformed  in  Table  Y. 

TABLE  Vn 

Thb  Average  Grades  or  Contusion,  and  the  Recognition  Scores  in  the  Unin- 
formed, the  Informed  and  the  Control  Groups,  with  the  Probable 
Errors  for  Different  Trademarks  of  Various  Amounts 

of  Confusion 

Oroupe 
Relative  Position  Uninformed  Informed  Control 


H 


x        "2  1 3  *i  Av- Per  Cent.  Reoognlsed  Ae:  *»  5 

o      |2      |S      >      H       *      .H       8      «        I     «        I      w  g 

SC         H  Q  <         Pu         ^         A<  S        fe  O        flu  2?        Pu  ^*         p* 

9    2.0-1.4    2.4    3.5    .14      89    5.1        8    5.0      65    5.5      27    SJ      86    5.6? 

10  4.5-5.5  1.0  4.9  .0?   44  f.0   17  5.1   52  S.8      31  5.5   83  5.7 

10  5.8-5.7   .9  6.3  .06      49  £.1   26  5.6   49  3.7      25  5.5   81  1.4 

10  7.0-8.9  1.9  7.8  J5      55  4.4   36  5.5   45  4.0      19  5.5   84  5.5 

The  relation  between  the  various  orders  may  also  be  seen  from 
their  correlations.  They  are  all  positive.  According  to  Spear- 
man's formula0  the  order  of  confusion  in  the  Informed  group  cor- 
relates +  0.70  (P.E.  0.061)  with  that  of  the  grade  of  relative  posi- 
tion, that  of  confusion  in  the  Uninformed  correlates  +  0.59  (P.E. 
0.076),  and  that  of  correct  recognitions  of  change  correlates  in- 
versely +  0.47  (P.B.  0.090),  and  that  of  incorrect  discriminations 
correlates  +0.19  (P.E.  0.109).  The  last  is  nearly  a  chance  cor- 
relation. In  Table  VII.  the  differences  in  the  regularity  of  the 
changes  in  the  scores  indicate  also  which  orders  correspond  more 
closely.    The  probable  errors  of  most  of  the  correlations  overlap. 

All  the  correlations  are  attenuated  by  the  fact  that  the  names  of 
the  commodities  contributed  to  causing  confusion  in  the  recognitions 
experiments,  whereas  the  relative  position  experiment  is  free  from 

•  These  differences  could  have  been  made  more  equal  if  we  had  taken  six 
ptead  of  four,  but  then  the  average  would  not  have  been  so  reliable. 

•  The  method  of  differences  in  relative  positions  or  ranks.   «  «  1 . 
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this  source  of  confusion.  It  is  perhaps  due  partly  to  this  that  the 
order  of  confusion  in  the  Informed  received  the  highest  correlation. 
Tho  the  name  of  the  article  appeared  there  it  was  not  so  much  of  a 
disturbing  factor  because  the  subjects  knew  that  the  change  would 
be  only  in  the  trade-marks.  In  the  Uninformed  group,  on  the 
other  hand,  it  did  contribute  to  cause  confusion  between  the  trade- 
marks, and  thereby  lowered  its  correlation  with  the  relative  position 
grades.  Finally,  while  the  correlations  demonstrate  that  measure- 
ment by  relative  position  is  useful  as  a  recognition  method  for  study- 
ing confusion,  they  tell  against  recent  criticisms  denying  its  prac- 
tical value. 

5.  Introspective  Notes 

How  did  the  individual  perform  the  task  of  judging  and  grading 
deceptive  similarity  f  Did  they  all  work  in  the  same  manner  t  Or 
did  some  adopt  their  own  methods  to  aid  them?  No  one  line  of 
thought  was  followed  by  all.  A  number  of  individuals  put  different 
emphasis  on  each  of  the  four  factors  noted  in  the  directions.  The 
judgments  of  some  were  based  mainly  on  similarities,  while  those  of 
others  on  differences.  Furthermore,  imaging  concrete  situations  in 
everyday  life  seemed  to  help  quite  a  few.  This  information  was 
obtained  by  asking  each  individual  after  he  had  arranged  the  trade- 
marks to  state  how  he  had  proceeded.  Only  a  general  statement 
was  required,  not  an  elaborate  introspection.  To  many  of  the  re- 
plies obtained  do  not  really  merit  the  name  of  proper  introspection, 
they  indicate  quite  a  variety  of  mental  performances.  Below  are 
given  16  different  statements  by  the  50  subjects.  It  would  be  in- 
teresting to  know  how  much  the  variability  of  the  grades  depends 
on  these  differences  in  method. 

1.  Confusion. 

2.  Confusion  and  similarity. 

3.  Similarity  in  appearance,  sound,  and  meaning. 

4.  Graded  in  order  of  importance  by  similarity  in  appearance, 

sound,  and  meaning. 

5.  Similarity  in  sound  given  high  confusion  rating. 

6.  Noted  similarities  more  than  differences. 

7.  Observed  differences  systematically. 

8.  Considered  the  ease  of  associating  the  rival  trade-marks. 

9.  The  most  important  words  given  most  weight. 

10.  Imagined  whether  he  would  mistake  the  imitative  trade-mark 
when  read  in  a  magazine  advertisement  for  the  original  seen 
first  in  another  part  of  the  magazine. 
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11.  Played  the  role  of  a  purchaser  looking  at  the  imitation. 

12.  Imagined  how  he  would  react  to  the  imitative  trade-mark, 

having  only  a  casual  acquaintance  with  the  original. 

13.  Tried  to  imagined  the  trade-mark  on  packages  in  a  store. 

14.  Considered  whether  others  would  be  confused. 

15.  Fancied  himself  a  clerk  in  a  store  trying  to  fool  the  pur- 

chaser with  the  imitation. 

16.  Direct  and  quick  comparison  of  the  trade-marks. 

6.  Summary 

1.  Every  imitation,  non-infringements  as  well  as  infringements, 
receives  some  grade  of  confusion. 

2.  The  relative  position  grades  of  the  imitations  do  not  divide 
into  two  distinct  groups,  suggesting  those  likely  to  deceive  and  those 
not  likely  to  deceive,  but  their  distribution  forms  a  continuum.  The 
last  two  findings  are  in  agreement  with  those  in  (4)  and  (5)  of 
Chapter  III.  telling  against  the  present  legal  procedure  in  regard  to 
imitations. 

3.  Even  the  random  and  dissimilar  matings  of  trade-marks  re- 
ceive a  grade  of  confusion,  all  being  lower  than  the  litigated  pairs. 

4.  The  analysis  of  the  methods  of  making  imitations  suggests 
certain  general  psychological  principles  for  determining  dangerous 
imitations.  These  principles  include  omissions,  additions,  substitu- 
tions, and  changes  in  positions. 

5.  There  are  fairly  high  correlations  of  the  order  of  confusion 
of  the  relative  position  grades  with  the  two  orders  of  confusion  in 
the  Uninformed  and  Informed  groups. 

6.  In  judging  and  grading  the  individuals  did  not  follow  a 
single  line  of  thought,  but  employed  methods  of  their  own  to  aid 
them. 


CHAPTER  V 

PSYCHOLOGICAL  TESTS  OP  THE  ACCURACY  OP  JUDICIAL 

DECISIONSi 

1.  The  Tests 

When  the  court  renders  a  decision  as  to  the  likelihood  of  con- 
fusion of  trade-marks,  instead  of  establishing  a  fact  it  merely  states 
an  opinion.  Unless,  there  is  a  dissenting  judge  the  court  probably 
believes  that  its  decision  is  correct.  But  no  court  has  undertaken 
to  see  whether  its  decision  was  right,  nor  to  see  whether  the  decision 
did  in  fact  conform  with  the  cited  authorities.  Scientific  investiga- 
tion would  further  suggest  that  even  the  authoritative  cases  be 
subjected  to  a  test.  As  long  as  these  things  remain  undone  the 
courts  are  traveling  in  the  dark.  The  recognition  and  relative  posi- 
tion experiments  that  we  have  been  examining  furnish  us  with  the 
means  of  determining  the  legal  and  psychological  accuracy  of  the 
decisions.  The  scanty  information  that  the  decision  conveys  is  one 
of  its  serious  defects.  It  rarely  advances  beyond  stating  that  there 
is  or  is  not  a  possibility  of  confusion,  and  making  a  comparison  be- 
tween the  trade-marks  in  the  pending  case  with  litigated  pairs. 
How  much  more  accurately  the  psychological  methods  can  answer 
these  questions  has  already  been  demonstrated. 

There  were  40  subjects  in  the  recognition  experiment,  all  of  them 
Uninformed.  There  were  40  in  the  relative  position  experiment ;  the 
serial  form,  not  the  group  form,  being  used.  The  nine  pairs  of 
trade-marks  studied  were  not  very  familiar;  as  may  be  seen  in 
Table  VIII.  There  the  results  of  the  recognition  and  relative  posi- 
tion experiments  are  given.  The  first  column  in  the  table  shows 
whether  the  imitation  in  the  decision  was  held  to  be  an  infringe- 
ment (I)  or  a  non-infringement  (N).  The  other  columns  are  self- 
explanatory. 

The  procedure  and  material  has  been  described  in  Chapter  II. 
However,  an  additional  word  might  be  said  about  the  nine  decisions, 
which  are  to  be  checked  up.  Five  were  adjudications  of  infringe- 
ment, in  which  the  use  of  the  imitation  was  enjoined,  and  four  were 

i  The  results  of  this  chapter  appeared  in  a  previous  article  by  the  writer,  "A 
Psychological  Study  of  Confusion  between  Word  Trade-Marks,91  Bull  of  the  V. 
8.  Trade-Mark  Assn.,  1915,  11,  101-114. 

ft* 
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9  TABLE  Vm* 

The  Pb  Cent,  of  Individuals  Contused,  the  Geads  of  Confusion  and  Pi 

ABLE  EeBOB  OF  EACH  OF  THE  INFRINGEMENTS  AND  NON-lNFEINOEMENTS 

Trade-Mark  Per  Cent.  At. 

Decfcfcm  Original  Imitative  Confuted         Grade  P.  E. 

N  Sosodont  Kalodont  28  3.6  J67 

I  Nox-aU  Non-X-Ell  28  4.9  JS 

I  Club  Chancellor  Club  35  2.7  Jl 

N  Bestyette  Veribeet  35  4.1  .SO 

N  Mother's  Grand-Ma's  38  3.2  .30 

I  Au-to-do  Antola  40  4.3  .51 

K  Peptenzyme  Pinozyme  43  5.2  JO 

I  Green  Biver  Green  Bibbon  50  5.7  J89 

I  Ceresota  Cressota  63  7.9  JL9 

adjudications  of  non-infringement,  in  which  injunctions  against  the 
use  of  the  alleged  illegal  imitations  were  refused.  The  results  ob- 
tained from  these  9  trade-marks  test  the  accuracy  of  the  decisions.  No 
oilier  circumstance  or  reason,  as  far  as  the  records  showed,  determined 
the  point  of  infringement  or  non-infringement  in  the  decisions.  This 
requirement  had  to  be  insisted  upon,  because  it  is  only  the  question 
of  likelihood  of  confusion  of  the  word  trade-marks  that  the  experi- 
ments measure.  If  various  other  factors  such  as  the  question  of  the 
validity  of  the  trade-marks,  unclean  hands,  similarity  of  the  type, 
color,  or  other  features  of  the  label  or  package  entered  in  the  deci- 
sion and  operated  to  influence  the  point  of  infringement,  the  experi- 
mental results  of  these  complicated  decisions  could  not  be  properly 
compared  with  each  other,  nor  with  simple  decisions  of  confusion 
of  just  word  trade-marks.  It  is  obvious  that  decisions  determined 
by  confusion  of  word  trade-marks  plus  certain  other  circumstances 
are  not  in  the  same  legal  nor  psychological  categories  as  those  de- 

*  Ceresota,  Cressota,  floor;   North   Western  Consolidating  Milling  Co.   v. 
Mansser  *  Grossman,  162  Fed.  Rep.,  1004  (U.  8.  Or.  Ct.). 

Nox-aU,  Non-X-Ell,  hats;  Noz-AU  &  Gotham  Co.  v.  Denzer  Goodhart  &  Co., 
2  Trade-Mark  Sep.,  356  (U.  8.  Dist  Ct.). 

Green  River,  Green  Bibbon,  whiskey;  Lang  v.  Green  Biver  Distilling  Co., 
148  O.G.,  280  (Ct  of  App.  D.  C). 

Crab,  Chancellor  Crab,  cocktails;  In  re  Herbst  Importing  Co.,  134  O.G.,  1565 
Ct  #f  App.  D.  C). 

An4o-do,  Antola,  cigars;  In  re  Wilcox  Co.,  162  O.G.,  539  (Ct  of  App.  D.  C). 
Bestyette,  Veribest,  raincoats;  New  York  Mackintosh  Co.  v.  Flam,  2  Trade- 
ark  Rep.,  324  (U.  8.  Dist.  Ct.). 

Sosodont,  Kalodont,  tooth  paste;  Sarg  Sohn  4b  Co.  v.  Hall  ft  Buekel,  165  O.  G., 
I  (Ct  of  App.  D.  C). 

Mother's,  Grand-Ma's,  waxing  pads;  Bromnnd  Co.  v.  Columbia  Wax  Prod- 
•  Co,,  S00  O.G.,  1115  (Ct  of  App.  D.  C). 
Peptenzyme,  Pinozyme,  digestant;  Beed  4b  Garniek  v.  Waterbury  Chemical 
100  O.G.,  279  (Ct  of  App.  D.  C). 
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termined  simply  by  the  confusion  of  just  the  word  trade-marks. 
Nor  could  the  former  be  properly  given  as  authorities  governing  the 
latter,  nor  vice  versa. 

Let  us  now  compare  the  recognition  scores  of  the  infringements 
and  non-infringements.  The  two  most  confusing  imitations  in  the 
recognition  and  relative  position  experiments  are  infringements, 
the  lowest  in  the  recognition  is  a  non-infringement  and  in  the  rela- 
tive position  is  an  infringement.  The  non-infringement  "Pepten- 
zyme — Pinozyme"  is  more  confusing  than  3  of  the  5  infringements; 
the  non-infringement  " Mother's — Grand-Ma 's"  is  more  confusing 
than  2  of  the  infringements;  and  the  non-infringement  "Bestyette — 
Veribest"  is  equal  in  confusion  to  one  infringement  and  more  so 
than  another.  Of  the  2  imitations  that  stand  at  the  bottom  one  is 
legal  and  the  other  illegal.  The  grades  of  confusion  in  relative  posi- 
tion show  likewise  that  the  non-infringement  "Peptenzyme — Pino- 
zyme" is  more  confusing  than  the  same  three  infringements.  The 
three  remaining  non-infringements  are  more  confusing  than  one  in- 
fringement. In  other  words  some  of  the  imitations  declared  to  be 
legal  actually  confused  more  individuals  than  some  imitations  de- 
clared to  be  illegal,  and  vice  versa.  Both  experiments  prove,  there- 
fore, that  some  of  the  decisions  are  inaccurate  and  inconsistent.  In 
several  of  the  above  comparisons  the  differences  between  the  scores 
are  not  large.  It  should  also  be  observed  that  many  of  the  pairs  of 
trade-marks  differ  only  little  in  confusion.  It  will  be  seen  that  the 
orders  of  confusion  in  recognition  and  relative  position  correspond 
fairly  well. 

The  average  grades  of  confusion  here  are  not  comparable  with 
those  in  Chapter  IV.,  tho  their  relative  amounts  are.  Some  recog- 
nition scores  of  the  trade-marks  recorded  here  and  in  the  two  previ- 
ous chapters  show  divergences  due  to  the  different  classes  of  sub- 
jects used  and  their  small  number. 

TABLE   IX 

The  Average  Per  Cent,  or  Confusion,  the  Average  Grade  and  Probable 
Error  or  the  Five  Infringements  and  Pour  Non-infringements 

Number  of  Av.  Per  Cent.  Av. 

Decisions  Decision  Confused  Grade  P.  E. 

5  Infringement  43  5.1  J>1 

4  Non-infringement  36  4.0  JB$ 

If  we  compute  the  averages  of  the  5  infringing  and  4  non-in- 
fringing imitations  in  Table  VIII.  we  get  the  figures  in  Table  IX. 
The  average  percentage  of  confusion  (43)  of  the  infringements  is  7 
per  cent,  higher  than  the  average  (36)  of  the  non-infringements. 
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The  advantage  here  is  as  it  should  be.  This  is  also  the  case  with 
the  average  in  relative  position.  The  average  grade  (5.1)  of  the 
infringements  is  1.1  higher  than  the  average  (4.0)  of  the  non- 
infringements ;  their  probable  errors  are  0.51  and  0.26  respectively.8 
Tho  the  differences  between  the  average  grades  show  that  on  the 
whole  the  courts  were  correct  in  their  judgments,  the  inaccuracies 
of  the  individual  cases  are  covered  up.  The  most  important  char- 
acteristic of  these  differences  is  their  small  amount.  Let  us  con- 
sider again  the  recognition  scores  in  Table  VIII.  In  view  of  the  fact 
that  the  largest  difference  between  2  infringements,  "Ceresota — 
Cressota"  and  "Nox-all— Non-X-EU"  is  35  per  cent,  and  that 
between  2  non-infringements,  "Peptezyme — Pinozyme"  and  "Sozo- 
dont — Kalodont"  is  15  per  cent.,  the  difference  here  of  7  per  cent, 
between  the  2  averages  becomes  insignificant.  The  grades  show  this 
discrepancy  more  decidedly.  Here  the  largest  difference  between  2 
infringements,  "Ceresota — Cressota"  and  "Club — Chancellor 
Club,"  is  5.2,  and  that  between  2  non-infringements,  "Peptenzyme — 
Pinozyme"  and  "Mother's — Grand-Ma's"  2.0,  whereas  the  differ- 
ence between  the  2  averages  is  only  1.1.  The  scores  of  the  two  sup- 
posedly distinct  decisions  are  thus  seen  to  overlap  throughout  most 
of  their  range.  The  differences  within  both  classes  of  decisions  out- 
weigh so  much  the  difference  between  the  classes  that  for  practical 
purposes  the  difference  in  confusion  between  the  infringing  and  non- 
infringing imitations  may  be  disregarded.  Therefore,  some  of  the 
judicial  decisions  are  unreliable  and  do  not  represent  two  really 
different  legal  or  psychological  categories.4 

2.  Summary 

1.  Some  of  the  imitations  declared  to  be  legal  by  the  courts 
actually  confused  more  individuals  in  the  recognition  experiment 
than  some  imitations  declared  illegal,  and  vice  versa.  The  results 
of  the  relative  position  method  confirm  this.  Therefore,  some  of  the 
judicial  decisions  were  inaccurate  and  inconsistent. 

2.  The  scores  of  the  imitations  of  the  two  supposedly  distinct 
decisions  overlap  throughout  most  of  their  range,  so  that  the  deci- 
sions do  not  represent  two  really  different  legal  or  psychological 
categories. 

*  The  probable  errors  are  calculated  from  the  average  grades  of  the  9  trade- 
;  if  they  had  been  calculated  from  the  individual  grades  they  would  have 
meh  smaller,  probably  one  half  as  large. 

'Several  other  experiments  by  the  writer,  as  yet  unpublished,  confirm  this 


72      PSYCHOLOGICAL  8TVDT\  OF  TBADE-MABK  INFBINGBMSNT 


3.  Concluding  Rtbmarkb 

In  conclusion  it  may  be  said  that  the  adoption  of  the  experi- 
mental method  of  measuring  confusion  of  trade-marks  will  insure 
several  advantages.  Trade-mark  legislation  will  become  more  effi- 
cient in  having  an  objective  standard  by  which  to  define  an  illegal 
imitation.  Judicial  decisions  will  become  more  accurate  and  will  be 
freed  from  being  blindly  governed  by  past  erroneous  decisions. 
Business  will  save  money  by  not  being  deprived  of  legal  trade-marks 
thru  inaccurate  decisions,  by  cutting  down  the  fees  of  trade-mark 
lawyers,  and  by  the  elimination  of  the  opportunity  of  frequently 
appealing  from  the  decisions.  Furthermore,  the  state  and  federal 
governments  will  economize  in  time,  money,  and  labor  spent  by 
Equity  judges  and  the  officials  in  the  Trade-Mark  Division  of  the 
Patent  Office.  Finally,  while  opening  a  new  field  for  applied 
psychology  the  experimental  method  will  aid  in  perfecting  the 
machinery  of  law  and  its  administration,  and  ip  purifying  some  of 
the  unfair  practices  in  business. 
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I.   HISTORICAL 

In  the  present  thesis  an  effort  has  been  made  to  combine  in  a 

single  study  three  main  points  of  investigation;  first,  the  genetic 

study  of  behavior;  secondly,  the  subject  of  individual  differences; 

and  thirdly,  a  consideration  of  the  exact  method  of  habit  formation 

employed  by  the  mice  that  have  been  tested  in  the  experiments  that 

are  now  to  be  reported. 

Practically  no  experimental  work  has  been  done  upon  individual 
differences  and  family  resemblances  in  animal  behavior.    In  most 
eases,  the  behaviorist  has  been  content  to  study  the  mass  reaction  of 
a  group  of  animals  to  external  stimuli,  and  in  the  main,  has  not  at- 
tempted to  treat  the  variability  of  his  group  because  of  the  relatively 
small  number  of  animals  tested.    Professor  J.  McEeen  Cattell,  about 
fifteen  years  ago,  began  to  apply  the  methods  of  genetics  to  the  study 
°*  conduct,  but  the  results  obtained  by  him  and  his  students  were 
not  published,  and  the  problem  has  been  given  to  me.    Yerkes  devotes 
a  chapter  of  his  book  on  "The  Dancing  Mouse,"1  to  differences  in 
behavior,  and  there  brings  together  results  for  variability  in  ".  .  . 
general  behavior,  rapidity  of  learning,  memory,  and  discrimination.' ' 
"is  results  showed  the  existence  of  a  considerable  amount  of  indi- 
^dual  differences  in  the  behavior  of  the  dancing  mouse,  and  no 
'anally  resemblance  in  the  litters  he  obtained.     He  does  not  give 
^^ntitative  results,  but  confines  himself  to  a  general  discussion  of 
"*e   individual  peculiarities  of  the  animals  he  had  tested.    The  fol- 
lowing quotation  from  his  text  expresses  this  point:  "I  noted,  in  this 
te&t  of  the  animals'  ability  to  learn,  that  while  one  individual  would 
**  scurrying  about  trying  all  ways  of  escape,  investigating  its  sur- 
r°1l*Hlings,  looking,  sniffing,  and  dancing  by  turns,  another  would 
*k^ote  all  its  time  to  whirling,  circling,  or  washing  itself.    One  in 
^  course  of  its  activity  would  happen  upon  the  way  of  escape,  the 
°«*er  by  reason  of  the  limited  scope  of  its  activity,  not  the  lack  of  it, 
^°Uld  fail  hour  after  hour  to  discover  even  the  simplest  way  of  get- 
~*H?  back  to  its  nest,  to  food,  and  to  its  companions.' '    Concerning 
J7e  "inheritance  of  forms  of  behavior,"  Yerkes  found  that  certain 
^*&  of  descent  exhibited  a  pronounced  tendency  to  whirl  to  the  left, 
^^fle  others  reacted  in  the  opposite  direction.   When  two  such  strains 
***e  crossed  the  offspring  showed  an  equal  frequency  of  left  and 

1  Yerkes,  Chapter  17,  ' '  The  Dancing  Mouse. ' ' 
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right  whirlers.  It  was  also  found  that  there  was  no  "inheritance  of 
individually  acquired  forms  of  behavior."  Apparently  the  descend- 
ants of  animals  that  had  been  previously  trained  to  learn  a  certain 
task  were  given  no  advantage  over  ordinary  individuals  from  un- 
trained stock. 

G.  V.  Hamilton  in  his  monograph  entitled  "A  Study  of  Persever- 
ance Reactions  in  Primates  and  Rodents/'2  found  that  there  were 
definite  types  of  behavior  exhibited  by  the  various  subjects  he  used. 
These  consisted  of  twenty  children,  a  baboon,  four  monkeys,  and  five 
kinds  of  rodents,  comprising,  one  mouse,  five  gray  rats,  five  black 
rats,  ten  white  rats  and  six  gophers.  The  reactions  of  the  monkeyB 
and  the  baboon  presented  a  considerable  range  of  individual  differ- 
ences, which  determined  the  experimenter  in  the  selection  of  his  sub- 
jects, as  indicated  in  the  following  quotation :  ' '  The  marked  individual 
differences  presented  by  the  five  infra-human  primate  subjects  reflect 
a  policy  of  selecting  subjects  in  whom  oddities  of  general  reactive 
equipment  had  been  observed."  Later  on  in  the  investigation  the 
author  refers  to  the  presence  of  individual  differences,  as  follows: 
"When  a  mammalian  is  confronted  by  a  series  of  situations  for  which 
he  is  unable  to  discover  and  stereotype  a  specifically  adequate  and 
invariably  successful  mode  of  response  he  tends  to  vary  his  response 
in  a  manner  which  is  less  a  species  than  an  individual  characteristic." 

The  writer  has  had  the  opportunity  of  going  over  the  original 
data  of  Basset's  work  on  white  rats,8  and  finds  that  a  certain  amount 
of  individual  difference  occurs  in  the  animals  he  tested.  Some  ani- 
mals did  consistently  better  work  than  others,  but  as  Basset  himself 
points  out,  his  numbers  were  too  few  to  make  possible  any  conclu- 
sions from  the  differences  that  were  observed. 

One  might  mention  a  large  number  of  isolated  cases  where  the 
literature  of  comparative  psychology  gives  evidence  of  individual 
differences.  It  would  not  be  worth  while  to  treat  them  here,  how- 
ever, because  they  generally  deal  with  relatively  few  animals,  and 
are  given  merely  as  side  issues  of  experiments  planned  to  bring  out 
other  factors. 

«  Hamilton, tl  A  Study  of  Perseverence  Reactions  in  Primates  and  Rodents," 
Behavior  Monograph  Series,  No.  13,  1916. 

s  Basset,  "  Habit  Formation  in  a  Strain  of  White  Rats  with  Less  than 
Normal  Brain  Weight,"  Behavior  Monograph  Series,  No.  9,  1914. 


II.   STATEMENT  OP  THE  PROBLEM 

The  plan  of  the  experimental  work  presented  in  this  investiga- 
tion is  to  measure  individual  differences  in  behavior,  to  determine 
the  extent  to  which  the  animal  that  departs  from  the  average  in  one 
direction  will  depart  in  others,  to  measure  the  resemblances  in  fami- 
lies and  in  lines  of  descent,  and  to  determine  whether  kinds  of  con- 
duct can  be  established  in  family  lines  by  selection.    In  a  previous 
publication,4  of  which  this  thesis  is  a  continuation,  it  was  found  that 
individual  differences  occurred  in  the  ability  of  various  strains  of 
mice  to  learn  a  simple  maze,  and  also  that  a  family  resemblance 
existed  among  mice  of  the  same  litter,  that  amounted  to  a  coefficient 
€>f  correlation  in  the  neighborhood  of  0.50.    Certain  mice,  and  even 
'whole  lines  of  descent,  showed  marked  variations  from  the  average, 
some  taking  more  than  twice  the  average  time  to  learn  a  given  task. 
-These  differences  were  well  beyond  the  limits  of  the  probable  error.  ^ 
^The  results  were  obtained  from  testing  90  mice,  as  determined  by 
"the  time  required  to  find  their  way  through  a  maze.    Since  then, 
These  mice  and  their  offspring  have  been  tested  in  other  ways,  and 
Arther  experiments  are  now  in  progress  with  the  F7  and  P8  genera- 
tional  In  the  present  investigation  there  are  described  the  individual 
differences  and  family  resemblances  of  93  mice,  in  addition  to  the 
**0    already  reported  on  in  the  previous  article.     These  mice  have 
b^n  tested  in  the  same  maze  as  were  the  previous  ones ;  in  addition, 
***^jr  have  been  given  an  interference  test,  a  retention  test  and  have 
"^^n  studied  in  a  second  maze,  as  described  below. 

4B*gg,  "Individual  Differences  and  Family  Resemblances  in  Animal  Be- 
**^ior,"  The  American  Naturalist,  April,  1916. 

The  present  material  was  submitted  for  publication  in  June,  1918. 
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TESTS  OF  LEARNING  ABILITY  1 

marked  in  the  diagram  1,  2,  3,  4.  Three  of  these  gates  are  blue  and 
one  is  red.'  Punishment  was  given  at  the  blue  gates,  bat  not  at  the 
red.    The  gates  are  the  same  size  as  those  used  in  the  maze  test  just 


*  The  Milton  Bradly  papers,  red  and  blue  were  used,  and,  in  so  far  as  the 
"pertinent  was  nut  designed  to  test  the  color  sense  of  the  animals,  the  brightness 
ralue  of  the  colors  was  not  determined.  The  papers  were  changed  from  time  to 
t"ae,  Vjnt  tile  odor  factors  were  not  eliminated.  These  clews,  if  they  existed  as 
lachf  fOT  t^  animals,  were  purposely  retained,  and  the  mice  were  allowed  to 
•*■*  use  of  them  in  solving;  their  problems. 


V.   EXPERIMENTAL  RESULTS 

(a)  Time  and  Error  Averages  for  All  Tests 

Tables  I.  to  VII.  give  the  time  and  the  number  of  errors,  i.e.f  the 
number  of  cases  in  which  the  mouse  tried  to  go  through  a  locked 
gate,  which  is  a  measure  of  the  activity  of  the  animal.    In  this  paper 
the  average  of  the  last  fifteen  trials  is  used  as  an  index  of  perform- 
ance for  the  first  set  of  seventeen  trials  in  the  maze  test,  and  the  last 
23  trials  are  used  as  an  index  for  the  25  trials  in  the  multiple  choice 
testy  in  each  case  the  first  two  trials  being  eliminated  for  irregulari- 
ties previously  mentioned.    The  groups  of  two  and  ten  trials  each  in 
the  interference  test,  and  the  group  of  ten  in  the  retention  test  are 
used  as  indexes  for  the  respective  cases.    The  above  tables  give  the 
complete  records  of  the  183  mice  tested,  grouped  in  families  as  de- 
scribed below.    The  average  time  is  54.12  ±  P.E.  2.3  seconds  per  trial 
for  the  last  fifteen  trials  in  the  maze  test ;  60.26  ±.  P.E.  4.7  seconds 
for  the  last  ten  trials  of  the  interference  test ;  52.81  ±.  P.E.  4.7  sec- 
onds for  the  retention  test,  and  39.47  ±  P.E.  .08  seconds  for  the  last 
23  trials  of  the  multiple  choice  test.    The  distributions  of  the  indi- 
viduals in  both  experiments  is  shown  in  Pig.  3.°    The  distribution 
for  the  animals  in  the  maze  test,  based  on  the  average  speed  attained 
™  the  last  fifteen  trials  is  indicated  by  the  solid  line,  and  the  distribu- 
5*°&  for  those  in  the  multiple  choice  test,  based  on  the  speed  attained 
111  the  last  23  trials,  by  the  broken  line.    In  the  maze  test  65  animals 
^°k  less  than  20  seconds,  in  47  cases  the  time  was  between  20  and  40 
*econds,  and  there  were  71  cases  between  40  and  360  seconds.    But 
***  mouse  failed  to  learn  the  maze.    The  distribution  in  the  multiple 
^°ice  test  gave  30  cases  in  which  the  time  was  under  20  seconds,  20 
c**^s  between  20  and  40  seconds,  and  26  cases  between  40  and  280 
Ootids.   None  of  the  mice  failed  to  learn  the  multiple  choice  test. 

'")  Difference  in  Learning  between  Families  of  White  and 

Yellow  Mice 

As  reported  in  the  preliminary  account  of  this  experiment,  it  was 
*&UBd  that  certain  strains  of  mice  took  considerably  longer  time  to 
k*m  the  maze  than  others  tested  at  the  same  time.    Among  the 

t8e?«Biy-fSz  of  the  183  esses  were  tested  in  both  the  mazes  given  in  these 
OtfrfUrtiasi. 
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TABLE  I 
Compijm  Time  and  Eeeoe  Bicofira  for  Tax  Tbuaw  Family  in  thx  Make  Tot 


In  the  first  cohmm  is  given  the  catalogu«  number,  color  and  sex  of  the 
mimtli.  In  the  second  are  the  time  averages  (in  seconds)  for  the  first  two 
trials;  in  the  third,  for  the  next  five  trials;  in  the  fourth,  the  last  tan  trials,  and 
in  the  fifth  column  the  average  of  the  two  preceding  columns.  The  error  average 
fox*  the  last  15  trials  is  given  in  the  last  row  of  figures.  This  order  is  followed  in 
all  the  subsequent  tables,  but  in  Tables  III  and  VI  averages  are  added  for  the  last 
group  of  five  trials,  and  in  addition  these  tables  give  the  time  and  error  averages 
for  two  interference  tests  of  two  and  ten  trials  respectively;  a  retention  test  of 
ton  trials,  and  finally  the  averages  for  the  multiple  choice  tost  of  33  trials,  which 
ia  divided,  first,  into  a  group  of  the  two  first  trials,  next  the  following  five  trials, 
next  the  last  18  trials,  next  the  last  23  trials,  next  the  last  five  trials,  and  finally 
the   error  averages  for  the  last  23  trials. 

One  daj'a  record  has  been  omitted  for  mice  Nob.  27,  28,  29  and  31  because 
tlae  poor  records  for  that  day  were  obviously  due  to  a  constant  error,  on  account 
of    traveling,  etc.    These  are  the  only  cases  where  such  a  condition  has  occurred. 

(c)  Resoltb  fob  the  Maze  Test 

Fig.  4  gives  the  complete  record  curves  for  all  the  tests  given  in 
tli«  maze,  showing  curves  based  upon  the  average  and  the  median 
record  for  each  day,  and,  as  indicated  in  the  drawing,  these  may  be 
divided  into  three  main  parts:  first,  an  initial  learning  period  of 
seventeen  trials,  seconds  the  interference  groups,  consisting  of  two 
and  ten  trials,  and  finally  a  retention  test  of  ten  trials.  183  mice 
were  tested  in  the  first  group  of  seventeen  trials,  and  71  in  each  of 
the  succeeding  groups.8  Two  daily  record  curves  were  calculated 
for  teach  test,  and  in  the  upper  curve  (represented  in  the  figure  by 
a  solid  line  end  marked  "average")  the  records  for  all  the  individ- 
uals in  each  group  were  averaged  for  each  successive  trial,  and  the 

*  The  tests  that  followed  the  initial  learning  period  of  seventeen  trials  were 
not  instigated  until  the  experiment  was  well  started  and  the  writer  had  become 
faniliar  with  the  peculiarities  of  the  behavior  of  his  subjects.  Borne  animals 
<ued.  during  the  rather  long  period  in  which  they  were  observed,  and  their  ineom- 
P'0**  records,  although  given  in  the  tables,  are  not  averaged  in  Fig.  4. 
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probable  error  calculated  for  each  point  in  the  curve.  In  accord- 
ance with  a  plan  proposed  by  Professor  Cattell,  the  limits  of  the 
probable  error  are  shown  by  the  broken  lines.  The  chances  are  even 
that  with  a  greatly  increased  number  of  cases  the  time  would  have 
remained  between  these  limits,  and  a  nearly  smooth  curve  can  be 
drawn  within  them.    When  the  gates  were  changed  at  the  eighteenth 

TABLE  II 
Compute  Bsoobds  roz  tht  Whir  Family  in  the  Mask  Tvst 


S 

trial,  an  interference  effect  occurred  that  resulted  in  a  rise  of  the 
time  curve  to  118  seconds  at  the  first  trial.  This  was  just  half  the 
number  of  seconds  it  took  the  average  mouse  to  go  through  the  mare 
for  the  first  time.  The  rest  of  the  interference  test  showed  an  aver- 
age time  curve  that  was  above  the  curve  for  the  last  few  trials  of 
the  initial  learning  test,  except  for  the  sixth  day  of  the  interference 
test  when  the  curve  dropped  to  40  seconds.  The  curve  based  on  the 
average  for  the  interference  test  began  to  follow  the  usual  course  of 
learning  until  the  sixth  day  when  the  maximum  speed  record  was 
reached,  but  at  that  point,  for  some  unknown  reason,  a  retarding 
factor  occurred  that  caused  a  decided  rise  in  the  curve  from  then  to 
the  end  of  the  test.  There  are  two  possible  explanations  for  this 
phenomenon;  first,  that  at  the  lowest  point  of  the  curve  the  mice 
had  reached  their  maximum  speed  and  efficiency  and  thereafter  they 
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became  "tired"  of  the  problem  and  lost  their  adjustment,  or  in  other 
words,  the  test  had  been  carried  too  long;  secondly,  the  following 
explanation  may  be  given:  the  drop  in  the  sixth  day  of  the  test  is 
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not  significant  and  represents  a  chance  irregularity  which  would  dis- 
appear from  the  curve  if  a  still  greater  number  of  animals  was  used. 
As  there  is  no  evidence  to  support  the  first  of  these  explanations,  it 
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probable  tbat  the  second  solution  is  the  correct  one.  We  can,  there- 
■e,  say  that  the  interference  as  shown  in  this  experiment  was  not  a 
jiaitory  thing,  being  evident  for  only  one  or  two  trials  after  its 
plication,  but  instead,  it  exerted  an  influence  over  a  number  of 
als  and  prevented  the  animals  from  attaining  the  same  degree  of 
jficiency  that  they  had  previously  shown  in  a  similar  task.  How- 
•r,  if  the  interference  test  had  been  continued  it  is  possible  that 
;  curve  would  have  reached  as  low  a  record  as  that  given  by  the 
tial  learning  test. 

TABLE  IV 


TABLE  V 
■  Bkco&ds  or  a  Sham,  Family  Showing  Good  Records  i 
Test 


n 

It  is  interesting  to  note  that  Hunter  and  Yarbrongh  found  that 
■erference  occurred  between  an  old  habit  and  the  formation  of  a 
w  one,  in  their  study  of  the  auditory  habits  in  the  white  rat.*  The 
.lowing  is  quoted  from  their  results:  "Habit  interference  occurs 
the  white  rat  between  a  first  habit  and  the  formation  of  the  second 
e."  "Interference  is  most  marked  between  the  end  of  the  per- 
ked habit  and  the  beginning  of  the  new  habit."  "Habit  inter- 
rence  may  serve  greatly  to  slow  up  the  formation  of  a  new  habit." 
le  results  of  this  investigation  agree,  in  the  main,  with  the  state- 
;nts  that  have  just  been  quoted,  but,  although  the  interference 
ect  caused  a  sharp  rise  in  the  time  curve,  and  the  interference  was 
"Walter  S.  Hunter  and  Jat,  N.  Yarbrongh,  "The  Interference  of  Auditory 
ibita  in  the  White  B»t,"  The  Journal  of  Animal  Behavior,  Vol.  7,  No.  1. 
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mtory  evidence  from  the  data,  and  it  must  be  remembered  that 
original  test,  although  older  than  the  interference  test,  still  re- 
ved  a  greater  amount  of  repetition.  It  appears  from  the  results 
the  experiment  that  the  condition  in  3  is  most  likely  to  account  for 

TABLE  vn 
CoHPLm  Bioobds  or  THi  Unrelated  Inmvuxjalb  in  the  Uui  Test 


the  facts ;  that  is,  the  transfer  of  capacity  developed  in  the  multiples 
choice  test  accounted  for  the  superiority  of  the  retention  test,  by- 
virtue  of  the  better  adjustment  that  the  animala  received  to  the  ex- 
periment as  a  whole,  and  by  practise  in  the  elimination  of  fruitless; 
movements.  The  number  of  seconds  required  for  the  average  r 
to  complete  the  first  trial  of  the  retention  test  is  below  all  but  one  od — 
the  records  that  the  same  mice  made  in  the  interference  test,  and  iU--:: 

is  noteworthy  that  the  curve  for  the  retention  test  based  on  the  daily 

average,  is  not  similar  to  either  of  the  preceding  curves,  bat  is  nearly      ~ 
flat,  except  for  a  slight  rise  at  the  last  trial.     Since  the  average—^ 
animal  did  not  start  with  a  high  time  record,  it  is  evident  that  it  did — 
not  need  to  learn  the  task  all  over  again,  but  showed  a  considerable^-' 
amount  of  permanence  of  association  for  the  previously  learned  task- 
The  curve  for  the  retention  test,  based  on  the  median  record  for' 
each  day,  confirms,  in  the  main,  what  has  already  been  said  concern- 
ing this  test.     The  curve  for  the  median  is  also  flat,  the  four  high- 
points  all  reaching  to  about  a  score  of  twenty  seconds,  and  it  again 
shows  the  relative  superiority  in  the  record  for  the  first  day  of  the; 
test.    Also,  taken  day  by  day,  the  records  for  the  retention  test,  with 
a  single  exception,  show  the  retent:jn  test  with  daily  records  su- 
perior to  the  corresponding  ones  of  the  interference  test. 

(tft  Results  for  Multiple  Choice  Test 

Fig,  5  gives  complete  record  curves  for  the  same  71  mice  as  tested 

by  the  multiple  choice,  and  the  limits  of  the  probable  error,  for  the 

curve  based  on  the  daily  average,  are  indicated  in  the  same  manner 

as  explained  for  the  previous  curves.    The  average  time  for  the  first 

"■  •  «'*ie  test  is  236  seconds  as  compared  with  91  seconds  u 
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the  average  for  the  first  trial  of  the  multiple  choice  test.  How  much 
this  difference  is  due  to  what  the  average  animal  acquired  in  the 
first  experiment  can  not  be  determined  since  the  tests  themselves  are 
markedly  different.10    In  the  first  place,  the  distance  to  be  traversed 


Number  oj  TriA)S 

Fig.  5.  Complete  Becord  Curves  for  Mice  in  the  Multiple  Choice  Test, 
blowing  curves  based  upon  the  average  and  the  median  for  each  day.  (The 
limits  of  the  probable  error  for  the  average  curve  are  indicated  by  the  broken 
lines.) 

In  the  multiple  choice  test  is  much  shorter  than  in  the  maze  test,  and 

*Jhe  intensity  of  punishment  is  greater  in  the  former  case  because 

"there  the  electric  shock  was  used.    Also  color  clews,  and  the  fact  that 

it  was  necessary  for  the  animal  to  go  through  only  one  door,  tend 

Xo  lessen  the  average  time  in  the  multiple  choice  test.    As  indicated 

in  the  previous  discussion,  there  was  no  doubt  a  transfer  effect  in 

learning  from  the  first  task  to  the  second,  that  would  again  result 

in  shortening  the  time  in  the  multiple  choice  test.    This  was  due; 

first,  to  a  better  general  adaptation  to  the  experiment  as  a  whole, 

^rhich  was  carried  over  from  the  maze  test ;  and  secondly,  to  the  fact 

that  an  important  element  was  common  to  both  tasks,  namely,  that 

in  each  case  the  animal  learned  to  escape  from  confinement  by  means 

of  a  door  that  could  be  pushed  open.    It  is  interesting  to  note  at  this 

point  that  Yerkes  in  his  study  of  the  dancing  mouse1  (see  page  263) 

found  that  experience  in  one  labyrinth  made  the  learning  in  a  second 

labyrinth  much  easier.     "Those  individuals  whose  first  labyrinth 

training  was  in  (labyrinth)  C  made  their  first  correct  trip  as  the 

result  of  19.7  trials,  whereas  those  which  had  previously  been  trained 

in  labyrinth  B  were  able  to  make  a  correct  trip  as  the  result  of  only 

7.0  trials.    Similarly  the  table  shows  that  training  in  C  rendered  the 

s*T%is  point  i»  being  more  closely  studied  in  an  experiment,  now  under  wj. 
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subsequent  learning  in  B  easier."  The  average  curve  in  Fig.  5  indi- 
cates that  there  is  practically  no  increase  in  learning  between  the 
seventh  trial  and  the  twenty-fifth.  A  fairly  uniform  decrease  in 
time  occurs  from  the  first  to  the  seventh  day,  when  an  average  speed 
of  twenty-six  seconds  was  made.  The  only  other  performance  that 
bettered  this  record  was  made  on  the  twenty-fourth  day,  when  an 
average  time  of  twenty-four  seconds  was  recorded.  The  number  of 
trials  in  the  multiple  choice  test  could  have  been  much  less  and  still 
sufficient  for  the  average  mouse  to  learn  the  maze.  It  was  impossible 
to  determine  that  more  trials  were  given  than  were  necessary  until 
the  experiment  was  well  started.  In  fact,  the  experimenter  arbi- 
trarily chose  twenty-five  as  the  number  of  trials  because  he  thought 
it  would  take  the  average  mouse  longer  to  learn  the  second  task  than 
the  first.  As  explained  above,  the  results  of  the  experiments  dis- 
approved this  assumption. 

In  the  multiple  choice  test,  the  curve  based  on  the  median  record 
for  each  day,  as  in  the  previous  tests,  is  considerably  below  the  cor- 
responding curve  for  the  average.  The  curves  here  are  essentially 
similar,  and  it  may  be  noted  that  the  curve  for  the  median,  after  the 
second  trial,  never  rises  higher  than  twenty  seconds  or  lower  than  ten. 


VI.   CORRELATIONS  IN  LEARNING  RECORDS 


V^k^Bious  correlations  have  been  calculated  for  performance  in  one 
task  ^mth  performance  in  another,  and  between  groups  of  trials 
^rithi^xi  a  single  task.  The  correlation  have  all  been  positive,  varying 
from  C3.ll  to  0.85  as  described  below.  A  complete  list  of  the  correla- 
tions    is  given  in  Table  VIII.    The  Pearson  formula, 


f 


3. 

4. 


5. 
8. 


TABLE  Vm 
Be8ui/ts  or  Correlations 


i 


-  '/•■ 


Things  Correlated 

Time  in  last  15  trials  of  maze  test  with  error  average  in  same  task 
Time  in  first  group  of  5  trials  in  maze  test  with  the  time  in  last 

group  of  5  trials  in  maze  test 

Time  in  last  15  trials  of  maze  test  with  the  time  in  retention  test . 
Time  in  last  15  trials  of  maze  test  with  the  time  in  the  first  2 

trials  of  the  interference  test 

Time  in  last  15  trials  of  maze  test  with  the  time  in  the  last  10 

trials  of  the  interference  test 

Time  in  last  23  trials  of  Multiple  Choice  test  with  error  average 

made  in  same  test 

Time  in  first  group  of  5  trials  in  Multiple  Choice  test  with  the 

time  in  last  group  of  5  trials  in  Multiple  Choice  test 

Time  in  last  group  of  15  trials  in  maze  test  with  the  time  in  last 

group  of  23  trials  in  Multiple  Choice  test 


CorretatiOM 


+0.85  •- 

+0.46 
+0.35 

+0.55  ^ 

+0.49  ^ 

+0.82 

+0.25 

+0.11  s 


r  = 


2(*  •  y) 


VsS*-  Vzy*' 


was  used  for  the  correlations  numbered  in  the  table  as  1,  2,  6  and  7. 
Because  the  remaining  correlations,  3,  4,  5  and  8  were  made  between 
two  groups  both  from  asymmetrical  distributions,  the  ranking  method 
was  used  with  the  following  formula : 


r  =  1  - 


62D* 


n(n*  -  1) " 


The  ranking  method  was  employed  so  that  undue  weight  would  not 
be  given  to  the  few  extreme  cases  in  the  skewed  distributions.  This 
disadvantage  did  not  occur  in  the  correlations  made,  between  time 
and  error,  and  performance  at  the  beginning  and  end  of  the  tests, 
so  in  these  cases  the  Pearson  formula  was  used. 

The  correlation  between  the  time  in  the  initial  learning  period 
in  the  maze  test  with  the  errors  made  during  that  performance 

23 
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two  interference  trials  was  +  0.55 ;  and  for  the  same  period  in  the 
maze  test  with  the  last  ten  trials  of  the  interference  test  the  correla- 
tion amounted  to  +  0.49. 

The  above  correlations  tend  to  show:  first,  that  the  animal  that 
does  well  in  any  one  task  is  likely  to  retain  more  than  one  that  does 
not  do  well ;  secondly,  time  and  error  are  closely  related  in  the  types 
of  behavior  that  this  investigation  deals  with,  and  one  is  a  measure 
of  the  other;  thirdly,  an  animal  that  does  well  in  the  beginning  of  a 
task  is  more  likely  to  do  well  at  the  end  that  an  animal  that  is  slow 
in  learning ;  fourthly,  the  animal  that  did  well  in  the  maze  task  ex- 
hibited greater  adaptability  in  behavior  than  one  that  did  not  do 
well,  as  shown  by  a  comparison  of  the  interference  records. 
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VIII.   SEX  DIFFERENCES 


(a)  Differences  in  Time  and  Error  Records 

Ik  Table  IX.  the  males  and  females  are  grouped  separately,  and 
their  average  times  and  errors  are  given  for  the  various  tasks  that 
were  used.  The  preliminary  report  of  this  investigation  showed  that 
there  were  small  sex  differences  for  performance  in  the  initial  learn- 
ing period  in  the  maze  test,  and  the  differences  that  did  exist  were 

TABLE  IX 

AVERAGES  FOR  SKX   DlJTERENCES   AND  SEX   VARIABILITY 


Inftml  Learning  Period,  Maze  Test . . 

Interference  Teat,  10  Trials 

detention  Test 

Multiple  Choice  Test 


A  rente  No. 

Mean  Vari- 

No. and 

of  Seem. 

ation!  In 

Probable 

Sex 

perTrUl 

Second* 

Error 

93  d1 

43.80 

33.5 

±2.9 

909 

64.77 

53.3 

±4.7 

34  o" 

37.76 

29.0 

±4.3 

37  9 

80.96 

56.8 

±8.0 

34  <? 

27.68 

21.8 

±3.2 

37  9 

76.00 

59.1 

±8.3 

34  d" 

25.76 

17.0 

±2.5 

37  9 

52.08 

35.1 

±4.9 

No. 
of  Errors 
per  Trla 


1.2 

1.7 
1.6 
2.8 
1.4 
2.9 
2.8 
3.9 


1 


within  the  limits  of  the  probable  error.  With  a  larger  number 
nimals,  93  males  and  90  females,  it  was  found  that  in  the  initial 
^^xming  period  in  the  maze  test,  the  males  did  considerably  better 
the  females.  The  males  made  an  average  time  per  trial  of 
0  ±  P.E.  2.9  seconds,  and  1.2  error  per  trial,  while  the  females 
e  a  corresponding  record  of  64.77  ±  P.E.  4.7  seconds  and  1.7 
r  per  trial.  As  previously  stated,  there  were  71  animals  that 
e  tested  in  the  interference,  retention  and  multiple  choice  tasks, 
of  these  34  were  males  and  37  females.  As  indicated  in  the  table 
sex  differences,  in  all  three  of  the  above  mentioned  tests  the 
^^xnales  took,  on  the  average,  twice  as  many  seconds  to  learn  the  tests 
made  considerably  more  errors  per  trial  than  did  the  males.  In 
interference  test  of  ten  trials  the  males  made  an  average  time  of 
3T.76  ±  P.E.  4.3  seconds  and  1.6  error  per  trial,  while  in  the  same 
task  the  females  took  80.96  dt  P.E.  8.0  seconds  and  2.8  error  per  trial. 
The  retention  test  records  gave  a  similar  result;  the  males  making  an 
ave*age  of  27.59  ±  P.E.  3.2  seconds  per  trial  and  1.4  error  per  trial, 
aQd  again  the  females  took  more  than  twice  as  long  to  perform  the 
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were  two  females  between  180  and  200  seconds;  one  between  200  and 
220  seconds;  one  each  between  240  and  260,  and  260  and  280  sec- 
)nds ;  and  finally  one  female  that  failed  completely. 
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Fig.  8.  Distribution  Carres  for  the  Males  and  Females  for  all  Tasks.  In 
*di  case  the  number  of  animals  is  given  by  the  ordinate,  while  the  abscissae 
-present  the  number  of  seconds  The  males  are  represented  by  the  solid  lines 
Qd  the  females  by  the  broken  lines. 
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The  distribution  curves  for  the  males  and  the  females,  for  the 
interference  test  of  ten  trials  in  the  maze,  are  also  given  in  Fig.  8. 
Here  it  is  to  be  seen  that  the  curve  for  the  males  is  distinctly  skewed. 
Seventeen  males  are  grouped  between  0  and  20  seconds;  eight  be- 
tween 20  and  40  seconds,  and  from  there  on  the  curve  is  similar  to 
the  one  made  by  the  same  animals  in  the  initial  learning  period  of 
the  maze  test,  but  in  the  present  case  no  males  are  to  be  found  that 
took,  on  the  average,  longer  than  200  seconds  to  complete  the  test. 
This  figure  shows  that  the  mode  for  the  females  is  to  the  right  of  the 
mode  for  the  males;  the  greatest  number  of  females,  namely  nine, 
are  to  be  found  between  40  and  60  seconds.  The  curve  for  the  fe- 
males is  irregular,  again  showing  a  superiority  in  favor  of  the  males, 
while  here  two  females  failed  to  learn  the  test. 

The  distribution  curves  of  both  sexes  for  the  retention  test  show 
that  the  curve  for  the  males  is  similar  to  the  one  above  that  we  have 
just  examined.  It  is  skewed,  with  the  mode  between  0  and  20  sec- 
onds, where  twenty-one  animals  are  to  be  found,  while  no  records  for 
the  males  exceed  160  seconds.  The  curve  for  the  females  is  less 
skewed  than  that  of  the  males;  an  equal  number  of  individuals, 
namely  nine,  are  to  be  found  between  0  and  20  seconds,  and  20  and 
40  seconds ;  the  curve  then  drops  quickly,  but  rises  again  in  the  re- 
gion between  60  and  80  seconds,  where  there  are  six  animals.  Then 
the  curve  for  the  females  gradually  falls,  but  again  shows  the  same 
characteristic  that  is  to  be  found  in  all  the  comparative  distributions, 
namely,  that  a  number  of  females  are  distributed  beyond  the  max- 
imum records  made  by  the  males  in  the  same  test.  In  this  case  five 
females  made  longer  average  time  records  than  the  males,  and  two 
of  them  failed  to  learn  the  test. 

The  distribution  curves  for  the  males  and  females  in  the  multiple 
choice  test  are  given  at  the  bottom  of  Fig.  8.  Here  the  mode  for  both 
sexes  is  to  be  found  between  0  and  20  seconds ;  but  the  curve  for  the 
males  is  steeper  than  the  corresponding  one  for  the  females;  twenty 
males  being  found  between  0  and  20  seconds;  seven  between  20  and 
40  seconds ;  five  between  40  and  60  seconds,  and  finally  two  between 
80  and  100  seconds,  which  is  the  maximum  time  record  for  the  males. 
The  distribution  curve  for  the  females  shows  eleven  individuals  be- 
tween 0  and  20  seconds,  and  then,  as  shown  in  the  figure,  the  curve 
drops  at  a  regular  rate ;  there  being  nine  individuals  in  the  next  time 
group,  seven  in  the  next,  four  in  the  next,  and  two  in  the  next,  where 
the  curves  for  both  sexes  meet.  It  is  to  be  noted,  however,  that  the 
same  thing  occurs  here  that  was  found  in  the  three  previous  distribu- 
tions, namely,  that  the  females  exceeded  the  maximum  time  records 
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of  the  males  that  were  tested  with  them  at  the  same  time.  In  this 
case  one  female  is  to  be  found  in  each  of  the  following  time  regions : 
100  to  120  seconds ;  140  to  160  seconds ;  160  to  180  seconds,  and  260 
to  280  seconds. 

(c)  Variability  of  the  Sexes 

An  inspection  of  the  probable  errors  of  Table  IX.  indicates  that 
the  behavior  of  the  females  was  much  more  variable  than  that  of  the 
males.  The  table  gives  in  detail  the  variability  of  the  sexes.  In 
the  initial  learning  period  of  the  maze  test  the  following  record  was 
made:  mean  variation  males,  33.5  seconds;  mean  variation  females, 
53.3  seconds;  while  in  the  interference  test  of  ten  trials  the  mean 
variation  for  the  males  was  29.0  seconds;  and  for  the  females  56.8 
seconds.  The  corresponding  records  in  the  retention  test  gave  a  mean 
variation  for  the  males  of  21.8  seconds  and  for  the  females  59.1  sec- 
onds. In  the  multiple  choice  test  the  mean  variation  for  the  males 
amounted  to  17.0  seconds,  while  for  the  females  35.1  seconds.  The 
average  of  the  variations  for  all  the  tasks  amounted  to  25.3  seconds 
for  the  males  and  51.0  seconds  for  the  females.  These  figures  show 
that  the  variability  in  the  behavior  of  the  females  was  about  twice 
as  great  as  that  of  the  males. 

The  above  results  in  sex  differences  and  variations  agree  with 
those  of  Hubbert  in  her  work  on  habit  formation  in  the  albino  rat.11 
The  following  is  quoted  from  her  results:  "The  general  averages  for 
an  equal  number  of  males  and  females  show  the  males  superior  to 
the  females  in  all  points  save  one,  that  of  absolute  time.  They  fin- 
ished in  fewer  trials,  required  less  total  time,  and  covered  a  smaller 
amount  of  distance  in  learning  the  problem  than  did  the  females, 
while  their  speed  was  slightly  higher.  .  .  .  The  mean  variation  from 
the  time  average  is  less  for  the  males  at  all  ages,  their  distance  varia- 
tion is  less  at  the  age  of  sixty-five  days  and  three  hundred  days." 

Yerkes  found  that  for  the  behavior  of  the  dancing  mouse  in  the 
black-white  discrimination  tests:  "The  males  almost  invariably  ac- 
quired a  perfect  habit  quicker  than  the  females  .  .  .  (but)  ...  in 
the  labyrinth  test  the  female  is  as  much  superior  to  the  male  as  the 
male  is  to  the  female  in  the  discrimination  tests.  ...  A  degree  of 
proficiency  in  labyrinth  'B'  attained  by  the  males  after  7.0  trials  was 
equaled  by  the  females  after  6.2  trials.  In  labyrinth  'C  the  males 
acquired  a  habit  as  a  result  of  18.7  trials ;  the  females,  as  a  result  of 
13.8.  And  similarly  in  labyrinth  'D,'  6.1  trials  did  no  more  for  the 
males  than  2.9  did  for  the  females. ' ' 

i»  Hubbert:  "The  Effect  of  Age  on  Habit  Formation  in  the  Albino  Bat," 
Behavior  Monograph  Series,  No.  11,  1915. 
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The  results  of  the  present  investigation  agree  with  those  found  1 
Terkes  concerning  his  discrimination  test,  but  do  not  agree  with  I 
results  for  the  labyrinth  test.  The  multiple  choice  used  in  the  pr< 
ent  experiments  was  primarily  designed  to  test  discrimination,  wh 
tending  to  destroy  position  habit,  and  so  it  may  be  considered  coi 
parable  to  the  discrimination  test  used  by  Yerkes.  Here  there 
agreement,  in  that  the  males  did  better  than  the  females,  but  in  t 
maze  test,  which  corresponds  to  Yerkes'  labyrinth,  the  results  of  tl 
investigation  agree  with  Humbert's  and  disagree  with  those  of  Yerk< 


IX.   INDIVIDUAL  DIFFERENCES  AND  METHODS  OF 

HABIT  FORMATION 

We  may  now  take  tip  in  more  detail  a  study  of  the  records  made 
by  a  few  of  the  animals  that  show  typical  or  exceptional  types  of 
behavior,  and  also  discuss  the  observations  made  on  the  methods  of 
habit  fixation.  In  Figs.  6  and  7  are  given  samples  of  practise  curves 
for  several  mice,  showing  the  daily  records  in  each  group  of  trials,  in 
the  order  that  they  were  given.  The  arrows  at  the  highest  points  on 
the  curve  indicate  that  the  mouse  did  not  pass  through  the  maze  or 
multiple  choice  test  within  360  seconds. 

In  Fig.  6  are  given  the  daily  record  curves  for  two  agouti  mice, 
131  Ag.  £  and  132  Ag.  $.  Their  average  time  records  are  given  in 
Table  VI.  They  are  mice  from  a  single  litter  and  their  records  show, 
in  both  cases,  very  rapid  and  consistent  learning  in  the  maze  test, 
remarkably  slight  interference  effect  at  the  eighteenth  trial,  followed 
by  a  complete  recovery  and  very  speedy  time  records  from  the  twen- 
ty-first to  the  twenty-ninth  trial.  No.  131,  whose  record  is  indicated 
by  the  solid  line,  made  a  record  in  all  the  tasks  which  was  consider- 
ably better  than  the  average.  It  showed  a  very  strong  retention  for 
the  maze  test,  while  the  records  in  the  multiple  choice  test,  although 
very  good,  show  a  more  irregular  performance  than  in  the  maze  test. 
This  irregularity  of  performance  in  the  multiple  choice  test  appears 
typical  for  the  mice  that  have  been  tested  in  this  investigation,  and 
the  irregularity  may  be  due  to  the  factors  peculiar  to  the  test  itself, 
or,  as  previously  discussed,  to  interference  effects  from  previous 
training.  No.  132,  whose  record  is  indicated  in  Fig.  6  by  a  broken 
line,  failed  to  get  through  the  multiple  choice  test  for  the  first  five 
days ;  succeeding  on  the  sixth  day,  it  made  fairly  good  records  there- 
after. These  two  mice  were  taken  as  examples,  because  they  typify 
the  characteristic  manner  in  which  good  time  records  were  made  by 
the  mice  that  were  tested  in  these  experiments.  The  writer  refers 
to  the  method  of  learning  by  rhythm  of  movements,  which  also  has 
been  noted  by  Watson,  Basset  and  others  for  white  rats.  It  was 
noted,  for  instance,  that  mouse  132  Ag  $,  in  the  initial  learning 
period  in  the  maze  test,  never  went  to  the  closed  gate  in  the  first  com- 
partment after  the  first  two  days  of  training.  For  a  week  of  learn- 
ing, from  the  fourth  trial  to  the  tenth  inclusive,  this  mouse  passed 
the  first  open  gate  successfully,  but  instead  of  going  on  to  the  open 
gate  in  the  second  compartment,  the  animal  invariably  m&ta  *  tatarox 
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TABLE  X 
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rst  going  to  the  closed  gate  in  the  second  compartment  before 
pleting  the  day's  record.    After  the  position  of  the  open  gate 
been  changed,  from  the  right  to  the  left  in  this  case,  at  the  inter- 
nee point,  i.e.,  the  eighteenth  day,  the  mouse  tried  to  pass  through 
previously  open  gates,  but  from  the  third  day  after  the  inter- 
«nce  had  been  given  a  new  rhythm  was  set  up,  which  lasted  until 
last  trial,  where  a  perfect  record  of  no  errors  was  made.    The 
3-^hm  in  this  case  reversed  the  previous  rhythm  by  the  mouse  try- 
to  pass  through  the  closed  gate  in  the  first  compartment,  but  fail- 
S  to  pass  this  gate  it  quickly  ran  around  to  the  successful  gate  and 
shing  through,  continued  on  to  the  open  gate  in  the  second  com- 
•  :rtment.    As  will  be  shown  in  an  accompanying  table,  it  is  interest- 
to  note  that  this  mouse,  except  for  the  first  three  days  of  training 
d  the  first  two  interference  days,  made  only  a  single  error  on  any 
e  day.    In  Table  X.  are  given  the  daily  error  records  for  the  same 
o  mice,  Nos.  131  and  132,  that  were  made  in  the  maze  test.    The 
ft  half  of  the  table  gives  the  complete  record  for  No.  131,  while 
the  right  is  given  the  record  of  No.  132.    The  first  column  gives 
e  number  of  days  and  indicates  the  extent  of  each  learning  period; 
e  second  column,  the  number  of  times  that  each  mouse  tried  to 
ass  through  the  closed  gates  in  each  compartment  (if  two  numbers 
^re  given  for  any  one  day  the  upper  number  represents  the  errors 
in  the  first  compartment  and  the  lower  one  errors  in  the  second  com- 
partment) ;  while  the  third  column  gives  the  number  of  trials  mada 
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at  the  open  gates.  The  errors  are  thus  given  in  the  second  column 
for  each  mouse,  while  the  number  1  in  the  third  column  merely 
means  that  the  animal  has  successfully  passed  through  the  open 

gates.  The  record  indicated  in  the  table  by:  1  1  and  found  to 
occur  on  the  fourth  day  for  both  mice,  is  repeated  several  times  for 
each  animal.  This  rhythm  may  be  interpreted  by  saying  that  the 
animal  successfully  passed  the  first  open  gate,  without  making  any 
errors  in  the  first  compartment,  but  ran  around  to  the  closed  gate  in 
the  second  compartment  and  was  thus  credited  with  an  error  before 
it  finished  the  day's  record.  By  a  glance  at  the  table  it  will  be  seen 
that  the  single  error  that  was  made  in  the  second  compartment  was 
not  eliminated  until  the  tenth  day  for  mouse  No.  131,  and  one  day 
later  No.  132  made  a  perfect  record.  This  same  error  occurred  once 
more  on  the  fifteenth  day  for  No.  131,  and  of  the  twelfth  and  four- 
teenth day  for  No.  132.  These  examples  are  typical  in  that  they 
show  that  errors  in  an  animal's  behavior  are  not  suddenly  discon- 
tinued, but  are  gradually  eliminated.  Further,  it  may  be  noted  that 
after  only  two  days  of  the  interference  test,  the  eighteenth  and  the 
twentieth,  No.  131  changed  its  entire  movement  habit ;  after  only  six 
errors  it  was  able  to  make  the  correct  turn  to  the  left  in  each  com- 
partment, while  before  the  interference  was  set  the  correct  turn  had 
been  to  the  right.  This  record  shows  a  rather  unusual  amount  of 
flexibility  of  behavior;  only  a  few  animals  have  been  observed  to 
make  a  similar  record.  In  fact,  if  such  records  were  found  to  be 
common  in  animal  behavior  we  would  have  to  alter  our  conception 
of  a  kinesthetic,  or  muscle  sense  movement ;  for  the  quick  readjust- 
ment as  exemplified  in  the  behavior  of  mouse  No.  131  would  hardly 
be  compatible  with  our  idea  of  such  a  sense.  The  observations  of  the 
writer  lead  him  to  believe  that  kinesthesis  was  the  all  important  ele- 
ment in  adjusting  the  movements  of  the  animals  that  were  observed 
in  this  investigation.  It  is  also  to  be  remembered  that  in  the  case  of 
No.  131  any  visual,  olfactory  or  gustatory  clews,  if  they  existed  as 
such  for  the  animal,  were  so  left  under  the  experimental  conditions, 
that  they  would  favor  the  production  of  errors  during  the  interfer- 
ence period  and  not  tend  to  their  elimination.  The  behavior  of 
mouse  No.  132  in  the  interference  period,  with  numerous  errors,  ap- 
pears to  be  the  more  general  type  of  animal  reaction. 

Turning  again  to  the  subject  of  the  fixed  rhythmic  type  of  be- 
havior it  may  be  seen  in  Table  X.  that,  in  the  case  of  No.  132,  the 

record  which  is  indicated  by  1    1  in  the  initial  learning  period, 
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"1     1" 

changed  to        1  in  the  interference  test,  and  this  particular  per- 
formance persisted  nearly  a  month  later  in  the  retention  period. 

It  has  been  noted  from  the  careful  study  of  each  animal's  be- 
havior, that  individual  errors,  or  tendencies  to  make  such  errors,  are, 
as  a  rule,  gradually  overcome,  that  a  wrong  movement  made  in  the 
first  few  trials  persists  throughout  several  succeeding  trials  in  a 
gradually  diminishing  extent.    One  mouse  persisted  in  turning  once 
to  the  left  gate  in  the  first  compartment,  when  the  gates  were  opened 
on  the  right  side.    It  continued  to  do  this  for  several  days,  when  it 
\ras  noted  that  it  began  to  go  only  part  way  to  the  left  gate;  then 
turning  around  it  took  the  successful  path.    This  mouse  never  com- 
pletely broke  the  habit,  but  in  the  end,  the  turn  to  the  left  had  de- 
generated into  a  quick  whirl  around  in  a  circle,  followed  by  a  dash 
thix>ngh  the  proper  gates.    This  type  of  behavior  has  been  noted  by 
other  observers;  the  following  is  quoted  from  page  32  of  Basset's 
taonograph :8  "As  in  the  maze  experiment,  many  of  the  inbred  rats 
Tir^re  subject  to  errors  which  persisted  throughout  the  experiment. 
Xrx     particular  may  be  mentioned  one  rat  that  invariably  formed  a 
loop  in  the  course  from  the  entrance  to  the  point  of  operation." 

JFig.  7  gives  the  daily  record  for  mouse  No.  134,  Agouti  ?,  whose 
^^~«x:age  time  records  are  given  in  Table  VI.    This  record  shows  an 
tial  set  of  seventeen  trials  in  the  maze  test  that  almost  duplicates 
theoretical  learning  curve.     The  daily  record  for  eight  days, 
the  'tenth  trial  to  the  eighteenth,  which  marked  the  application 
the  interference  test,  shows  that  the  animal  approximated  the 
biological  limit  of  performance;  taking  an  average  time  of  one 
ond  per  trial  and  making  no  errors  at  all  during  that  period.    The 
t^rference  effect  for  the  animal  is  slight,  as  shown  by  the  first 
rap  of  two  trials,  the  remaining  ten  trials  of  the  interference  are 
ittle  irregular,  but  the  noticeable  individual  difference  in  the  be- 
►^vior  of  this  mouse  is  to  be  seen  from  the  very  poor  record  it  made 
the  multiple  choice  test.     It  did  not  make  a  successful  trip  in 
»t  test  until  the  sixth  day  and  then  failed  for  eleven  consecutive 
lys,  from  the  eighth  to  the  eighteenth  day,  inclusive,  and  also  failed 
the  twenty-second  day.    During  all  these  trials  the  animal  ap- 
^ared  to  be  in  very  good  health,  it  was  active  in  the  apparatus  as 
ell  as  in  its  nest  box  and  made  plenty  of  errors  in  testing  the  col- 
doors.    It  is  tempting  to  speculate  that  the  poor  records  of  this 
louse  in  the  multiple  choice  test  were  due  to  an  interference  effect 
^^arried  over  from  the  previous  training  in  the  maze,  but  perhaps  the 
^•elatively  poor  retention  test  that  followed  would  seem  to  disprove 
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this  assumption.  This  case  indicates  that  an  experimenter  can  pre- 
dict the  actions  of  an  animal  to  only  a  limited  degree,  for,  after  mak- 
ing consistently  good  records  in  any  one  task,  some  external  or  in- 
ternal factors,  unknown  to  the  investigator,  may  become  operative 
and  break  up  the  expected  sequence  of  learning.  It  also  emphasizes 
the  importance  of  testing  an  animal  in  more  than  one  task  before  we 
finally  grade  its  behavior. 

If  space  permitted  it  would  be  interesting  to  give  in  detail  the 
learning  curves  of  mice  that  illustrate  still  other  kinds  of  individual 
differences.  It  may  be  well  to  call  attention  to  the  average  records 
of  mouse  No.  147  (see  Table  III.),  that  failed  completely  to  make 
a  successful  trip  through  the  maze,  although  it  was  tried  in  every 
one  of  the  tests.  It  finally  succeeded  in  making  the  poor  average 
record  of  159  seconds  in  the  multiple  choice  test,  but  when  retested 
at  the  time  the  retention  test  was  given  to  the  other  mice,  it  again 
failed  completely  in  the  maze  test.  Because  of  the  great  amount  of 
individual  differences  among  the  animals,  it  is  difficult  to  find  the 
record  of  a  single  mouse  that  made  a  record  that  was  similar  to  the 
average  for  each  task.  Only  No.  133,  whose  averages  are  given  in 
Table  VI.,  and  No.  189,  in  Table  III.,  approximated  an  "average" 
record.  The  record  of  No.  142,  in  Table  III.,  is  interesting  in  that 
it  shows  consistently  uniform  performance  throughout  all  the  tasks. 
This  mouse  made  the  following  averages:  36  seconds  in  the  initial 
learning  period,  24  seconds  for  the  first  two  interference  trials,  36 
seconds  for  the  last  ten  interference  trials,  35  seconds  for  the  mul- 
tiple choice  test,  and  33  seconds  for  the  retention  test.  Another 
type  of  animal  behavior  is  to  be  seen  in  the  case  of  mice  that  made 
very  poor  records  in  the  initial  maze  tests,  and  good  records  in  the 
multiple  choice  and  retention  tests.14 

The  multiple  choice  test,  which  did  not  favor  the  production  of  a 
stereotyped  form  of  reaction,  nevertheless  showed  some  interesting 
types  of  individual  and  group  responses.  It  was  found  that  the 
animals  exhibited  three  types  of  behavior,  which  were  not  definite, 
but  merged  one  into  the  other,  so  that  an  animal  might  use  one  of 
them  on  a  certain  day  and  another  type  on  the  next.  The  types  of 
reactions  were  as  follows: 

Type  1. — Response  by  slowly  and  carefully  "examining,"  visu- 
ally or  otherwise,  each  of  the  colored  doors,  very  suddenly  becoming 
oriented  and  dashing  through  the  successful  red  gate. 

Type  2. — The  animal  would  react  by  trying  the  gates  in  a  definite 

i«See  records  of  the  following  mice  in  Table  III.,  Nos.  138,  153,  154,  165, 
171,  178,  181,  187,  188,  206,  207,  209,  210,  211,  212,  and  in  Table  IV.,  No.  169. 
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order,  from  right  to  left,  or  left  to  right,  but  going  through  the  un- 
locked door  as  soon  as  it  was  reached. 

Type  3. — Responding  by  trying  the  gates  once  each,  in  an  irregu- 
lar manner,  and  finally  going  through  the  right  gate  apparently  by 
chance. 

It  was  noted  that  the  majority  of  the  animals  that  were  observed 
in  this  investigation  used  types  2  and  3  interchangeably.  A  few 
animals  used  type  1  for  several  days  in  succession  and  appeared  to 
actually  discriminate  before  they  made  their  final  choice  of  the  gates. 
This  type  1  reaction  was  noted  by  Burtt  in  his  experiments  entitled, 
"A  Study  of  the  Behavior  of  the  White  Rat  by  the  Multiple  Choice 
Method."15  In  the  case  of  one  rat  he  says:  "In  problem  1  she  would 
at  times  become'  oriented  very  suddenly,  dash  to  the  right  end  and 
then  across  to  the  correct  door. ' '  Types  2  and  3  of  this  investigation 
correspond  to  the  B  and  C  types  found  by  Hamilton  in  the  study  of 
primates  and  rodents.3 

i«  Harold  C.  Bnrrt, ' '  A  8tudy  of  the  Behavior  of  the  White  Bat  by  the  Mul- 
tiple Choice  Method,"  Journal  of  Animal  Behavior,  May,  1916,  Vol.  6,  No.  3. 


X.   HEALTH  CONDITIONS  AND  LEARNING  ABILITY 

It  is  generally  conceded  that  bodily  changes  in  the  general  health 
of  an  animal  may  greatly  tend  to  interfere  with  the  formation  of 
habits.    This  investigation,  however,  has  shown  that  a  number  of  ani- 
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Fig.  9.    Daily  Record  Curve  for  156,  White  rf,  that  gave  good  records  although 

stunted  and  very  ill  throughout  all  the  test. 

mals  have  made  exceedingly  good  records  although  they  were  appar- 
ently in  very  poor  health.  They  were  put  through  the  tests,  more 
out  of  curiosity  to  see  what  they  would  do  than  for  anything  else, 
and  the  experimenter  was  surprised  to  find  them  making  very  good 
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records  up  to  the  very  day  they  died.  An  example  of  such  a  case  is 
shown  in  Fig.  9,  which  gives  the  daily  record  of  No.  156,  White  <£, 
who  although  stunted  and  very  ill  throughout  the  experiment,  never- 
theless made  good  records.  This  mouse  did  not  seem  to  care  for  the 
reward,  which  was  the  food  to  be  found  at  the  end  of  a  successful 
trip,  and  when  it  returned  to  its  next  box  it  suddenly  became  very 
inactive,  and  did  not  appear  to  arouse  itself  again  until  it  was  tested 
the  following  day.  The  tables  also  indicate  the  incomplete  records 
of  several  mice  that  made  good  records  up  to  the  time  of  their  death, 
and  show  that  when  a  habit  is  once  firmly  fixed  it  may  resist  a  good 
deal  of  distracting  influences. 
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made  a  quick  time  record  of  15  seconds.  The  records  for  this  branch 
of  the  strain  are  given  in  Fig.  13.  As  in  the  other  branch  we  have 
just  discussed,  No.  91  again  produced  an  exceptionally  quick  and 
uniform  family  in  the  sixth  generation.  This  litter  was  composed  of 
three  males  and  three  females,  Nos.  122  to  127  inclusive.  Four  in 
the  litter  made  time  averages  of  fifteen  seconds  or  lower,  while  the 
other  two  took  32  and  33  seconds  each.  Their  family  average 
amounted  to  19.1  ±  P.E.  3.4  seconds.    No.  125,  with  an  average  of  9 
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Fig.  13.    Continuation  of  the  White  Family,  No.  91  mated  with  No.  86. 

seconds,  and  No.  127,  whose  average  was  15  seconds,  were  mated  and 
they  produced  in  the  seventh  generation  two  litters.  Thje  first  was 
composed  of  six  mice,  Nos.  155  to  160  inclusive ;  two  were  males  and 
four  females.  All  these  mice  made  averages  slower  than  any  of  their 
sixth  generation  kin.  One  male  made  an  average  of  62  seconds,  two 
females  gave  average  records  of  about  90  seconds,  one  of  44  seconds 
and  another  of  49  seconds.  The  family  average  here  was  fairly  high, 
amounting  to  66.4  ±  P.E.  7.6  seconds.  The  second  litter  was  com- 
posed of  two  males  and  three  females,  but  Nos.  172  and  11$  <&tfl\fe- 


FAMILY  HiaTOSIsa 


ftt\S: 


x 


V) 


© 


o-i 


LZJI 


go  * 

ill 


8*1 

i  I 


FAMILY  HIST0BIE8 


55 


tests,  while  the  other  female,  No.  148,  made  a  poor  record  of  72  sec- 
onds. It  is  to  'be  noted  again  that  in  the  seventh  generation  of  this 
branch  of  the  white  family,  four  of  the  females  made  time  records 
inferior  to  any  of  those  made  by  the  males  of  the  same  generation. 
Another  family,  mostly  of  yellow  mice,  was  derived  from  a  yellow 
female  and  an  unknown  male,  probably  white.  The  first  generation 
from  this  mating  gave  a  litter  of  six,  Nos.  32  to  37  inclusive.  The 
records  of  five  of  these,  one  having  died,  are  given  in  Table  IV.  and 
are  graphically  represented  in  Fig.  15.  This  litter  gave  a  family 
average  of  56.6  ±  P.B.  10.1  seconds.  Two  of  the  males,  Nos.  32  and 
33,  made  poor  records;  No.  3#,  an  average  record  of  56  seconds; 
while  the  remaining  male  made  a  fairly  good  record  of  37  seconds. 
No.  37,  the  only  female  of  this  litter,  gave  a  record  of  17  seconds ; 
she  mated  but  once,  and  it  is  not  known  with  which  brother.  She 
bore  in  the  second  generation  two  females  and  -a  male,  Nos.  54,  55 
and  56.  One  female,  No.  54,  made  a  record  of  35  seconds,  while  the 
other  female  made  a  poor  record  of  112  seconds.  The  male,  No.  55, 
also  did  poorly  with  an  average  of  150  seconds.    No.  54  and  No.  56 
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Nos.  196  to  199  inclusive;  while  No.  129,  average  16,  XNo.  134, 
average  95,  gave  mice  Nos.  167  to  170  inclusive.  The  litter  of  No. 
131  X  No.  133  was  composed  of  a  gray  male,  with  an  average  of  40 
seconds;  a  gray  female,  with  an  average  of  61  seconds;  a  yellow 
female  that  made  the  very  poor  record  of  134  seconds,  and  one  agouti 
female,  No.  199,  that  died  before  its  records  were  completed.  This 
agouti  female,  however,  made  very  good  records  in  the  initial  learn- 
ing, and  both  interference  periods  of  the  maze  test  before  it  died.  Its 
records  may  be  considered  similar  to  those  of  No.  156,  already  dis- 
cussed (see  Fig.  12).  The  family  average  for  the  first  litter  in  the 
third  generation  was  78  d=  P.E.  22.4  seconds.  The  second  litter  in 
this  generation  was  composed  of  Nos.  167  to  170  inclusive;  offspring 
of  No.  129  X  No.  134.  The  family  consisted  of  three  males  and  one 
female ;  there  was  a  yellow  male  and  a  yellow  female,  a  gray  male, 
and  finally  a  black  mouse  also  a  male.  The  two  yellow  individuals, 
Nos.  167  and  168,  made  tie  poor  averages  of  81  and  82  seconds  re- 
spectively; the  black  colored  male  took  47  seconds,  while  the  gray 
male  54  seconds.  Their  family  average  was  66  ±  P.E.  7.7  seconds. 
This  experiment  has  not  extended  far  enough  to  give  as  yet  any 
definite  results,  but  it  is  interesting  to  note,  that,  -as  was  found  in  the 
case  of  the  white  mice,  the  males  continue  to  make,  on  the  whole, 
better  average  records  than  the  females,  and  the  three  yellow  mice, 
Nos.  198, 167  and  168,  in  the  third  generation  make  the  poorest  time 
records  in  their  respective  litters.  If  there  is  a  tendency  for  the 
yellow  mice  to  be  slow  to  learn,  this  point  can  only  be  finally  deter- 
mined as  the  work  of  this  investigation  continues. 
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EXPERIMENTAL  STUDIES  IN   RECALL  AND 

RECOGNITION 


CHAPTER  I 

Historical  Survey 

Memory  has  been  mentioned  in  literature  for  centuries,  as  Burn- 
ham1  (5)  has  shown  in  his  survey  of  the  history  of  the  subject  The 
first  scientific  study  of  the  subject  was  in  the  time  of  Aristotle;  his 
doctrines  and  conceptions  as  well  as  those  of  Plato,  St  Augustine, 
Leibnitz,  Bacon,  Locke,  Hume,  Hartley,  Kant  and  others,  are  inter- 
esting, but  not  until  1885  do  we  find  a  record  of  any  experimental 
work.  During  the  years  1879-80  and  1883-84  Ebbinghaus  (7)  per- 
formed upon  himself  a  long  series  of  experiments  in  memorizing 
nonsense  syllables-  Experimental  researches  on  memory  have  con- 
tinuously increased  since  Ebbinghaus  published  his  results.  Here 
will  be  considered  those  which  have  been  concerned  with  the  differ- 
ences between  recall  or  reproduction  and  recognition. 

As  methods  of  testing  memory,  reproduction  and  recognition  were 
distinguished  by  Wolfe  (17)  in  1886.  In  studying  the  memory  of 
tones  he  found  it  easier  to  use  the  method  of  recognition  and  rejected 
that  of  reproduction  which  Ebbinghaus  had  employed.  Baldwin  and 
Shaw  (1),  in  determining  the  accuracy  of  the  memory  for  the  size  of 
a  square,  used  three  different  methods — (1)  Selection  from  variety, 
(2)  Identification,  (3)  Reproduction.  Memory  curves  were  made  for 
these  methods  and  found  to  be  practically  parallel,  but  the  degree  of 
accuracy  much  higher  by  the  second  method  than  by  the  first.  In  the 
method  of  reproduction  the  subjects  after  having  seen  the  square 
were  requested  to  draw  it  The  reproductions  were  always  too  small. 
Binet  has  published  notes  on  the  experimental  study  of  memory  to 
which  Warren  has  referred.  We  quote  in  part:  (1)  Method  of  Re- 
production— this  consists  in  making  the  subject  reproduce  his  im- 
pression; if  it  is  a  story  that  he  has  listened  to,  he  repeats  or  writes 
it ;  if  it  is  a  visible  form,  he  sketches  it ;  if  it  is  a  sound  or  an  inflec- 
tion, or  some  visible  movement,  he  imitates  it;  if  it  is  a  color,  he 
reproduces  it  by  mixing  the  tints  on  a  palette  or  varying  the  sectors 
of  rotating  discs.   This  is  certainly  the  most  natural  method,  in  that 
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tared  A,  is  again  given  one  or  more  stimuli  and  required  to  pro- 
nounce upon  the  relation  if  identity  which  the  latter  holds  (or  hold) 
to  the  former.  Thus  the  method  of  reproduction  is  to  be  distin- 
guished from  that  of  recognition  by  the  fact  that  in  the  former  only 
<me  artificially  given  stimulus  is  required  in  each  experiment,  while 
in  the  latter  at  least  two  are  necessary." 

Bean  (2)  says  that  the  curve  of  forgetting  can  be  properly 
measured  by  reproduction  or  recognition  and  that  the  rate  of  for- 
getting differs  with  the  method. 

Among  the  investigators  to  conduct  experiments  with  the  primary 
interest  to  determine  the  difference  between  recall  and  recognition  is 
MeDougall  (13).  He  presented  the  material  in  two  forms,  first  he 
exposed  ten  monosyllabic  words  simultaneously  for  a  period  of  ten 
seconds  to  each  of  his  two  subject*  In  the  second  case  they  were 
presented  verbally.  Afterwards  the  observers  were  asked  to  write 
down  all  that  they  could  recall  within  a  minute.  Then  from  a  set 
of  twenty  containing  the  original  ten,  they  were  requested  to  identify 
as  many  as  possible.  The  difference  in  the  per  cent,  recalled  and 
recognized  is  about  twenty.    The  results  were  as  follows : 

Visual 

Subfeot  Rceall  Beoofnltion 

A  54.3%  69.7% 

B  59.5%  84.3% 

Average   56.9%  77.0% 

Auditory 

A  50.0%  74.0% 

B 57.0%  74.3% 

Average   53.5%  74.15% 

The  data  are  too  meager  to  draw  any  general  conclusions,  except 
perhaps  that  more  can  be  recognized  than  recalled. 

Heine  (10)  gave  the  recognition  test  by  presenting  the  objects 
one  at  a  time  and  asked  the  subject  to  state  if  each  aroused  a  "dis- 
tinct impression"  of  being  known  or  if  it  was  difficult  to  say,  or  if 
the  impression  was  absent.  The  time  of  each  was  taken  and  the 
correct  recognitions  were  quicker  than  the  wrong  or  doubtful  ones. 
Heine  also  found  that  retroactive  inhibition  had  no  effect  on  recogni- 
tion, but  did  affect  recall. 

Strong  (16)  has  used  the  recognition  method  extensively.  One 
of  the  most  noticeable  results  of  experimental  work  is  that  recogni- 
tion is  easier  than  recall  and  has  a  higher  score.  Strong  found  that 
about  17  out  of  20  words,  after  being  presented  once,  could  be  recog- 
nised immediately  afterwards;  this  is  a  much  higher  «mtc«  \b&&  to* 


HISTOBIC  SUBVBY 


\ 

\ 


"9.  The  effective  element  is  very  much  more  pronounced  in  recog- 
nition than  in  recall 

"10.  The  wide  difference  in  results  obtained  from  the  different 
groups  under  different  conditions  shows  how  unreliable  it  is  to  derive 
general  laws  from  small  groups  of  subjects  arbitrarily  tested.  There- 
fore the  conclusions  herein  derived  are  necessarily  limited  to  the 
tests  described  in  this  study,  until  they  shall  have  been  verified  by 
further  studies.  ^ 

"11.  Some  sex  differences  are  obvious:  \ 

"  (a)  The  girls  are  superior  to  the  boys  for  both  recognition  and 
recall,  and  much  more  for  recall  than  for  recognition.    Their  superi- 
ority for  recall  invariably  holds  true  even  when  divided  into  grades,       \ 
while  for  recognition  this  superiority  obtains  only  for  large  groups. 

"  (6)  The  most  striking  sex  different**  is  shown  in  the  ratio  of 
recognition  to  recall;  while  on  the  average,  the  boys'  efficiency  for 
recognition  is  three  times  that  of  recall,  the  ratio  by  the  girls  is  about 
two.  Likewise  the  total  gain  in  per  cent.,  in  recognition  efficiency 
over  that  of  recall  is  markedly  superior  for  the  boys. 

"(c)  A  higher  correlation  between  recall  and  recognition  obtains 
for  girls  than  for  boys. 

11  (d)  For  recall  the  girls  seem  to  be  more  variable  than  boys, 
while  for  recognition  the  opposite  holds  true. 

"(e)  The  girls  recall  more  incorrect  words  than  the  boys,  while 
the  boys  recognize  more  incorrect  words  than  the  girls. 

"  (/)  Both  for  recall  and  recognition  a  higher  percentage  of  the 
total  answers  given  by  the  girls  than  those  given  by  the  boys  are 
correct." 

Hollingworth  (11)  says  "the  difference  between  recall  and  recog- 
nition seems  to  be  a  rather  simple  matter.  Recall  is  that  aspect  of  . 
memory  process  in  which  a  setting,  a  background  or  association- 
cluster,  is  present  in  clear  consciousness,  but  a  desired  focal  element 
is  missing.  .  .  .  Recognition  is,  schematically,  just  the  reverse  of 
this  process.  In  recognition  the  focal  element  is  present,  in  the  form 
of  sensation,  image,  or  feeling,  and  the  question  is  whether  or  not 
this  element  will  recall  a  more  or  less  definite  general  sitting  or  back- 
ground. ...  It  is  often  said  that  recognition  is  an  important  part 
of  recall  memory,  giving  warrant  to  the  correctness  of  the  recalled 
element.  This  may  often  be  the  case,  but  it  is  not  necessarily  so. 
Items  may  be  correctly  recalled  but  not  recognized  as  correct  and 
rejected.  Moreover,  every  case  of  recognition  presumably  involves 
recall  or  tendency  to  recall  on  the  part  of  the  setting.  Tta  arfoufcrj 


CHAPTER  n 
The  Pboblem  Stated 

Different  problems  in  the  field  of  the  experimental  work  on 
memory  have  been  examined.  Often  the  data  of  various  investigators 
on  similar  problems  have  been  apparently  incomparable  due  to  the 
difference  in  methods  of  testing  memory.  For  some  time  it  has  been 
known  that  one  can  recognize  more  items  than  one  can  recall,  but  it 
has  not  been  known  whether  the  recognition  memory  can  be  stated 
as  two,  three  or  four  times  the  recall  memory,  or  whether  the  posi- 
tion at  the  beginning  or  end  of  a  list,  or  other  factors,  will  influence 
recognition  as  much  as  they  do  recall.  There  are  no  data  to  prove 
that  one  who  recalls  well  can  also  recognize  well;  nor  whether  the 
results  which  exist  for  one  material,  i.e.,  words,  would  be  equally 
evident  for  another  material,  i.e.,  nonsense  syllables  or  geometrical 
forms. 

The  present  investigation  has  been  primarily  designed  to  examine 
the  similarities  and  differences  in  the  two  methods  of  testing,  repro- 
duction and  recognition.  The  questions  which  it  has  aimed  to  an- 
swer are : 

1.  What  is  the  equivalence  of  repetitions  in  Recall  and  Recogni- 
tion of  different  materials  f 

2.  Does  the  factor  of  determination  to  remember  influence  recall 
and  recognition  in  the  same  way  f 

3.  Does  primacy  effect  recall  ?  —  recognition  ? 

"    recency      " 

"    color 

"    size  "        "  " 

4.  Does  the  person  who  recalls  one  material  well  also  recognize 
that  material  well  J  Is  the  answer  the  same  for  different  materials  f 
Is  it  true  for  both  adults  and  children? 

5.  Does  the  person  who  recalls  one  material  well  also  recall  an- 
other material  well?  Is  the  answer  the  same  for  both  adults  and 
children? 

6.  Does  the  person  who  recognizes  one  material  well  also  recog- 
nize another  material  well?  Is  the  answer  the  same  for  adults  and 
for  children? 

7.  Is  a  material  which  is  recalled  well  also  recognized  well  ? 
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8.  Are  there  any  sex  differences  in  achievement  among  the  adults 
in  recall  f — in  recognition  t 
I  9.  Are  there  any  sex  differences  in  variability  among  the  adults 

V      or  among  the  children  in  the  recall  of  the  different  materials  f — in 
..^  the  recognition  of  the  different  materials! 

10.  Is  there  any  difference  in  recall  among  the  children  of  the 
same  age  regardless  of  class  in  school  f — in  recognition  t 

11.  Is  there  any  difference  in  recall  among  the  children  of  the 
same  grade  regardless  of  age  T — in  recognition  f 

12.  Is  there  any  difference  in  the  amount  recalled  or  recognised 
by  children,  college  students,  and  graduate  students  t 

13.  Do  tests  for  recall  and  recognition  on  insane  subjects,  who 
have  memory  defects,  reveal  any  characteristic  differences  between 
the  methods  f 


? 


CHAPTER  III 

Preliminaby  Experiments 

Further  experimental  investigation  into  the  relation  of  the  two 
memory  processes,  recall  and  recognition,  was  stimulated  by  Hol- 
lingsworth's  article  on  "Characteristic  Differences  between  Recall 
and  Recognition."1  His  title  suggests  that  there  are  two  differ- 
ences, but  his  conclusions  are  only  tentatively  drawn,  due  to  the 
meager  data.  To  add  to  the  data  on  points  which  he  raised  was 
the  purpose  of  these  preliminary  experiments.1  The  first  questions 
asked  were: 

1.  What  is  the  equivalence  of  repetitions  for  recall  and  recog- 
nition ! 

2.  What  is  the  influence  of  the  factor  of  determination  to  remem- 
ber on  recall  and  recognition  f 

3.  What  is  the  effect  of  the  factors  of  primacy  and  recency  t 

1.  Equivalence  of  Repetitions 

"It  is,  of  course,  a  matter  of  common  experience  that  a  single 
presentation  may  suffice  to  enable  recognition  but  be  quite  insuffi- 
cient to  make  recall  possible, ' '  says  Hollingworth.  The  experiments 
of  the  present  writer  were  designed  to  determine  the  difference  in 
the  number  of  repetitions  necessary  for  the  mastery  of  fifteen  items 
for  four  materials,  pictures  of  objects  (lamp,  fish,  clock,  etc.),  geo- 
metrical forms,  words  (chair,  hammer,  car,  doll,  etc.)  and  nonsense 
syllables  (fik,  vod,  deb,  ruz,  biv,  etc.). 

"Mastery"  was  measured  for  both  recall  and  recognition.  Each 
subject  was  shown  fifteen  words  successively  at  regular  intervals  of 
two  seconds  each  and  then  required  to  write  those  he  remembered; 
in  the  case  of  the  pictures  of  objects,  the  name  of  the  object  was 
written.  A  set  of  thirty  (30)  containing  the  original  fifteen  (15) 
was  given  to  the  subject  from  which  he  was  to  select  fifteen  which 
he  thought  were  in  the  original  set.  The  first  set  of  fifteen  was  pre- 
sented again  as  before  and  the  subject  was  requested  to  recall  those 

i  Hollingworth,  H.  L.  "Characteristic  Differences  between  Becall  and  Rec- 
ognition," Amer.  J.  of  Psych.,  1913. 

'Mnlhall,  Edith  F.  "Experimental  Studies  in  Becall  and  Recognition," 
Amer.  J.  of  FtyeK,  1915. 
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Pictures  Remembered  Why  and  How 

butterfly Benefit  performance  of  Madam  Butterfly  to 

be  given  for  the  College. 

ear Its  many  uses,  with  engine,  auto,  etc 

coat Livery. 

bridge A  particular  bridge  in  Sullivan  County. 

lamp  Toaster  received  yesterday  which  I  con- 
nected to  a  lamp. 

nuts Walnuts  I  bought  to-day. 

Words 

tree  Curious  tree  examined  on  a  recent  walk. 

knife Bread. 

Syllables 

naf Nap. 

jod Jodl,  psychologist 

Forms:  The  forms  reminded  the  observers  of  "a  diamond,'9  "a 
wind-mill,"  "exclamation  point,"  "color  disc,"  "pie,"  and 
"kindergarten  shapes." 

The  introspections  of  both  subjects  show  clearly  the  method  of 
association  in  recalling  the  material  and  the  difficulty  and  often  in- 
ability of  remembering  material  with  few  or  no  associations. 

Since  the  greatest  difference  in  recall  and  recognition  memory 
is  for  pictures  when  the  material  has  an  abundance  of  association, 
less  for  forms  and  words,  and  least  for  syllables  where  associations 
are  respectively  less,  it  appears  that  the  difference  in  recall  and 
recognition  memory  is  in  part  dependent  on  the  richness  of  associa- 
tions present. 

2.  Influence  of  Determination  to  Remember 

Hollingworth's  data  on  this  point  were  gathered  in  an  experi- 
ment in  which  each  of  five  observers  performed  the  "opposites" 
test  60  to  75  times.  The  task  was  to  speak  the  opposite  of  each  of 
fifty  adjectives  as  quickly  as  possible.  One  or  two  trials  were  made 
each  day  but  the  order  of  the  list  was  changed.  After  60  to  75  trials 
each  observer  was  asked  to  reproduce  all  the  pairs  of  opposites  that 
had  been  used.  Recognition  was  tested  by  presenting  one  hundred 
pairs  of  opposites,  containing  fifty  new  pairs  and  the  fifty  original 
ones,  and  asking  the  observer  to  identify  the  original  fifty.  The  re- 
sults were: 

Bg.  In  3  Mln.  or 


Re.  In  3  Mln.    Ba.  In  \&  Mfo. 

ArerMge.of  tire  observers 14.8  %&.%  4&& 
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photographs  in  three  minutes.  A  set  of  forty  photographs,  twenty 
being  those  of  the  original  set  without  names,  was  provided  with  the 
following  directions: 

'  'Select  20  pictures  from  this  group  which  you  think  were  previously  shown. 
Name  any  which  you  can.'1 

After  the  subject  had  selected  the  photographs,  a  set  of  forty  cards 
on  each  of  which  was  typewritten  a  name  (twenty  were  the  names 
attached  to  the  photographs  in  the  original  set,  twenty  were  other 
names)  was  used  for  the  recognition  of  names.  Care  was  taken  not 
to  repeat  any  name,  either  first  or  last,  nor  to  use  the  last  name  of 
any  well-known  person. 

The  second  group  of  twenty-five  subjects  first  copied  the  list  of 
syllables  and  names  on  the  pictures.  This  was  done  in  order  to  con- 
trol the  conditions,  keeping  them,  as  far  as  possible,  identical  with 
those  of  the  first  group.  If  such  a  record  had  not  been  required  for 
the  group  which  was  judging,  one  could  not  be  sure  that  the  subjects 
read  the  names.  Even  with  this  precaution,  the  subjects  claimed 
they  had  never  looked  at  them,  until  reminded  they  had  written  each 
on  the  blank. 

After  making  these  copies,  the  subjects  of  the  second  group  were 
given  a  set  of  fifteen  nonsense  syllables  with  these  instructions: 

"You  will  be  given  2  minutes  to  look  at  these  15  syllables.  Later  you  wiU 
be  called  upon  to  remember  them,  so  look  at  each  with  a  determination  to  remem- 
ber it." 

After  two  minutes  had  expired,  the  set  of  photographs  was  presented 
with  the  directions : 

"You  will  be  given  2  minutes  to  look  at  these  20  pictures.  You  win  after- 
wards be  called  upon  to  remember  the  names  and  photographs,  so  look  at  each 
with  a  determination  to  remember." 

Recall  and  recognition  were  tested  in  the  same  way  as  for  the  first 
group. 

Throughout  the  experiment  an  attempt  was  made  to  keep  the 
conditions  for  both  groups  the  same.  Any  sources  of  error  or  awk- 
wardness in  conducting  the  experiment,  due  to  the  difficulty  of  keep- 
ing the  observers  of  the  first  group  ignorant  of  the  purpose  of  the 
investigation,  which  may  give  rise  to  criticism,  will  be  found  to  be 
constant  for  both  groups. 

The  purpose  of  the  experiment  was  (1)  to  compare  recall  mem- 
ory, with  and  without  determination  to  remember,  with  recognition, 
with  and  without  determination  to  remember,  respectively;  (2)  to 
compare  recall  and  recognition  with  determination  and  recall  and 
recognition  with  no  factor  of  determination  present  \  and  <$\  <&\  ta 
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Since  some  subjects  might  recognize  more  names  than  photo- 
graphs and  others  more  photographs  than  names,  the  score  for  recog- 
nition includes  the  number  of  photographs  and  names  recognized. 

TABLE  V 

Emtio  of  Dei.  Be.  of  Syllables  to  Det  Be  of  Names 100:   86.8 

Batio  of  Undet.  Be.  of  Syllables  to  Undet.  Be.  of  Names 100:   61.1 

Batio  of  Det  Bg.  of  Syllables  to  Det.  Bg.  of  Names  and  Photo- 
graphs     100:  260.6 

Batio  of  Undet  Bg.  of  Syllables  to  Undet.  Bg.  of  Names  and  Photo- 
graphs     100:267.9 

In  Table  V.  the  materials  are  compared.  The  ratios  of  recall  of 
syllables  to  recall  of  names  are  presented  with  no  determination  and 
with  determination  to  remember ;  the  ratios  of  recognition  of  syllables 
to  recognition  of  photographs  and  names  with  and  without  deter- 
mination to  remember  are  also  stated. 

It  will  be  noticed  that  fewer  photographs  were  recognized  when 
there  was  a  determination  to  remember  present,  but  many  more 
names.  This  does  not  mean  that  determination  to  remember  de- 
creases one's  ability  to  recognize  faces.  The  larger  number  of  names 
recognized  with  determination  to  remember  seems  to  indicate  that 
the  observers  considered  names  more  difficult  to  remember  and  spent 
most  of  the  time  allotted  to  them  to  learn  names.  The  total  number 
of  photographs  and  names  recognized  with  determination  to  remem- 
ber was  850  and  without  852,  or  an  average  in  each  case  of  34  items. 
Throughout,  the  calculations  involving  the  recognition  of  the  ma- 
terial with  greater  meaning  the  totals  850  and  852  have  been  used. 
Frequently  a  subject  could  recall  the  first  or  last  name  but  not  both ; 
in  each  case  the  score  of  one  half  was  given  (Table  VI.). 

TABLE  VI 
Recall  of  Names 

No  Determination  Determination 

lit  2d  1st  2d 

Only      Only       Both  Only         Only       Both 

Total 40        50        32  49  62        79 

Total  first  names 72  128 

Total  last  names 82  141 

The  data  indicate  the  following:  (1)  the  factor  of  determination 
to  remember  influences  recall  memory,  but  its  effect  on  recognition 
is  little,  if  any;  (2)  the  difference  between  recall  and  recognition 
is  less  when  there  is  a  determination  to  remember  the  material  than 
when  there  is  no  intention  to  remember ;  (Z)  the  ta&a&iu&  <£  tatat- 
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urination  for  the  recall  of  names  is  greater  than  for  the  recall  of  non- 
sense syllables;  there  is  little,  if  any  effect  of  determination  to  re- 
member on  the  total  number  of  items  recognized  of  either  material. 
A  farther  study  of  the  data  for  the  recall  of  names  shows  inter- 
esting results.  When  no  determining  factor  was  present  72  first 
names  were  recalled  and  with  determination  128,  or  an  increase  of 
77  per  cent. ;  with  no  determination  to  remember  82  last  names  were 
recalled,  with  intention  present  141,  or  an  increase  of  72  per  cent. ; 
with  no  determination  total  number  recalled  77  and  with  determina- 
tion 134.5,  or  an  increase  of  75  per  cent.  Determination  to  remem- 
ber seems  to  influence  the  recall  of  first  and  last  names  to  the  same 
degree.  Determination  to  remember  influences  greatly  the  number 
of  first  and  last  names  correctly  connected,  as  there  were  only  32 
with  no  determining  factor  and  79  with  one,  or  an  increase  of  147 
per  cent.  Moreover,  the  determining  tendency  influences  the  num- 
ber of  photographs  which  may  be  correctly  named.    Table  VII.  shows 

TABLE  VII 
Names  Cob&bctly  Associated  with  Photographs 


No  Determination 

Determination 

lat 

3d 

Both 

Total 

lat 

2d 

Both 

Total 

Total 

...  2 

9 

13 

18.5 

10 

24 

48 

65.0 

Highest  score 

...   1 

3 

4 

4 

3 

4 

7 

8 

Lowest  score  . 

...   0 

0 

0 

0 

0 

0 

0 

0 

the  number  of  first,  last,  and  whole  names  which  were  correctly  as- 
signed to  the  photographs  for  both  groups  of  subjects.  According  to 
the  method  of  scoring  adopted,  18.5  names  were  correctly  given  to 
the  photographs  by  the  first  group  and  65  by  the  second. 

The  data  seem  to  indicate  that 

Determined  recall  differs  from  undetermined  recall  more  than 
determined  recognition  differs  from  undetermined  recognition. 

The  difference  between  determined  recall  and  determined  recog- 
nition is  less  than  that  between  undetermined  recall  and  undeter- 
mined recognition. 

The  influence  of  a  determining  factor  is  greater  for  recall  of  ma- 
terial rich  with  associations  than  for  material  devoid  of  them. 

The  determining  factor  influences  the  amount  of  material  remem- 
bered which  can  be  correctly  associated  with  other  material  remem- 
bered. 

3.  Primacy  a/nd  Recency 

The  third  part  of  the  investigation  was  concerned  with  determin- 
ing the  influence  of  primacy  and  recency  on  recall  and  recognition. 
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Ninety-one  subjects  were  tested  for  two  materials,  nonsense  syllables 
and  photographs.  To  nineteen,  a  list  of  twenty-four  nonsense  syl- 
lables was  presented  at  the  rate  of  one  item  every  two  seconds  in  a 
given  order  (noe.  1-24).  Immediately  after  the  presentation  they 
were  asked  to  recall  all  they  could  in  three  minutes  and  then  were 
given  a  list  of  forty-eight  from  which  to  select  24  which  they  thought 
had  been  previously  presented.  The  subjects  were  then  shown  twen- 
ty-four pictures  at  the  rate  of  one  every  two  seconds.  As  each  was 
presented  a  name  was  pronounced  by  the  experimenter.  Immedi- 
ately after  the  presentation,  they  were  given  three  minutes  in  which 
to  recall  the  names.  A  set  of  forty-eight  photographs,  containing 
the  original  twenty-four,  was  used  for  the  recognition  test.  Each 
subject  was  then  provided  with  a  list  of  forty-eight  names  from 
which  to  select  twenty-four  which  he  thought  had  been  pronounced 


TABLE  vm 

Primacy  and 

Regency 

Material: 

Syllables. 

Process: 

Recall 

Order  of  Presentation 

Total 
1-24 

Total 
13-24. 
1-12 

Total 
7-24. 
1-fl 

Total 

19-2 

1-18 

Grand 
Total 

Percent 
of  At. 

1    .. 

11 

12 

10 

22 

55 

206.2 

2    .. 

8 

8 

8 

8 

32 

119.9 

3    .. 

9 

10 

3 

8 

30 

112.5 

4    .. 

10 

4 

2 

12 

28 

104.9 

5    .. 

2 

7 

3 

3 

15 

56.2 

6   .. 

6 

4 

11 

8 

29 

108.3 

rr 

1 

6 
0 

4 

8 

5 

10 

3 
5 

7 

18 
12 

27 

67.5 

8   . . 

2 

44.9 

9   .. 

6 

101.2 

10   .. 

3 

5 

1 

11 

20 

74.9 

11   .. 

4 

4 

10 

4 

22 

82.5 

12   .. 

3 

3 

2 

5 

13 

48.7 

13   .. 

9 

2 

10 

6 

27 

101.2 

14   . . 

1 

10 

4 

7 
3 

3 

4 

21 
16 

78.7 

15   .. 

5 

59.9 

16   .. 

3 

7 

7 

15 

32 

119.9 

17   . . 

5 

1 
2 

2 
6 

8 
6 

16 
17 

59.9 

18   .. 

3 

60.4 

19  .. 

8 

2 

4 

15 

29 

108.3 

20  .. 

4 

6 
5 

10 
3 

8 
12 

28 
21 

104.9 

21   .. 

1 

78.7 

22   .. 

8 

11 

7 

7 

33 

120.3 

23  ., 

3 

8 

12 

17 

40 

149.9 

24  .. 

9 

12 

21 

16 

58 

217.5 

19 

19 

25 

28 

91 

Total  . 
Averag 

...  639 

26.67 

100 
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TABLE  IX 
Material:  Names.    Proe&u:  BecalL 

Tool  Total  Total 

Total  18-94,  7-M.  19-S4, 

OPdor  of  rrte ntatlon      1-M             1-12  1-6  1-19 

1    2.7            1.5  4.5  3.5 

2    0              0  2.0  9.0 

3    2.5           3.5  5.5  9.0 

4   1.0           2.0  5.5  7.5 

5 5            3.0  6.5  10.5 

6   2.5           1.5  9.0  5.5 

7    1.0           L5  6.5  5.0 

8    .5           4.0  1.5  4.0 

9    1.0           L5  13.0  13.5 

10    US           2.0  3.0  7.0 

11    2.0            2.5  6.0  4.0 

12    JS           1.5  5.5  5.0 

13    5.5            2.0  2.0  2.5 

14    &           0  10.5  2.0 

15    4.5           4£  6.5  4.0 

16    2.0           2.0  8.0  2.5 

17    2.5            1.5  14.5  8.0 

18    1.5           2.0  7.5  9.5 

19    1.0            1.0  7.0  7.5 

20    6.0             JS  2.5  5.0 

21    2.5            2.5  7.5  9.5 

22    7.5            3.5  8.0  11.5 

23    7.0  13.0  1(X5  14.5 

24    11.5  19.0  23.0  28.0 

Total    67.0  76.0  176.0  183.0 

No.  of  Subject*  . . . .  19  19  25  28 

Average  per  position 20.9 


Total 

of  At. 

11.5 

55.0 

11.0 

52.6 

20.5 

98.0 

16.0 

76.5 

20.5 

98.0 

18.5 

88.5 

14.0 

67.0 

10.O 

47.8 

29.0 

138.7 

13.5 

64.6 

14.5 

69.3 

12.5 

59.8 

12.0 

57.9 

13.0 

62.2 

19.5 

93.3 

14£ 

69.3 

21.5 

102.9 

20.5 

98.0 

16.5 

78.9 

14.0 

67.0 

22.0 

105.2 

30.5 

145.9 

45.0 

215.3 

81.5 

390.0 

502.0 

91 

100 
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TABLE  IX  {Continued) 

Material:  Photographs.    Process:  Beeognitbra 

Total  Total  Total 

Total  18-24  7-24  10-24 

Order  of  Presentation             1-24  1-12  1-6  1-18  Total 

1 11  16w  12  14  53 

2 11  8  16  19  54 

3  14w  14w  17  14  59 

4  3  15  11  22w  51 

5 9  11  15  25  60 

6   llw  11  ia  21  55 

7 10  10  llw  17  48 

8  15  17  15  11  58 

9  13  7  17w  25w  62 

10 4  12w  16  17  49 

11 14  13  10  13  50 

12  4  13  17  23w  57 

13  16w  12  14  18  60 

14  7  8  17  17  49 

15  lOw  16w  15  18  59 

16  10  3  18w  8  39 

17 15  10  19  19  63 

18   12  13w  13  10  48 

19   10  14  15  26w  65 

20   15  14  9  10  48 

21  4  11  21w  20w  56 

22   13w  5  10  19  47 

23 17  15  9  10  61 

24 10  3  llw  21  45 

Total   258  271  340  417  1286 

No.  of  Subjects 19  19  25  28  91 

Average  par  position 53.6  100 

(w  indicates  photograph  of  a  woman.) 


of  At. 

98.9 
100.7 
110.0 

95.2 
111.8 
102.6 

89.6 
108.2 
115.7 

91.4 

93.3 
106,3 
111.8 

91.4 
110.0 

72.7 
117.5 

89.6 
121.3 

89.6 
104.5 

87.7 

95.2 

83.9 
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TABLE  IX  (Continued) 
Material:  Names.    Procesi:  Becognition. 

Total  Total  Total 

Total         18-24           7-24          10-24  Par  Cent. 

Order  of  Pnatntatfon             1-24           1-12             1-6            1-18           Total  of  At. 

1 18            13            20            21            72  105,4 

2 6              8            18            28            60  87.8 

3 16            18            17            24            75  109.8 

4 15            15            22            21            79  106.9 

5 12            17            21            27            77  112.7 

6 14            15            23            22            74  108.3 

7 18            12            16            25            71  103.0 

8 6            18              9            26            59  86.4 

9 12            12            24            28            76  111.1 

10 9            13            23            26            71  103.9 

11 13            11            23            19            66  96.6 

12 12            12            20            20            64  93.7 

13 14            12            16            21            63  92.2 

14 7            12            24            11            54  79.0 

15 16            15            22            20            73  106.9 

16 10            13            17            20            60  87.8 

17 11            11            23            21            66  96.6 

18 11            11            22            22            66  96.6 

19 9             12            22            21            64  93.7 

20 18            11             17            18            64  93.7 

21  9            11            21            23            64  93.7 

22  14            10            22            27            73  106.9 

23  19            16            21            23            79  115.7 

24 15            18             18            24            75  109.8 

Total   304  316  481  538        1639 

No.  of  Subjects 19  19  25  28  91 

Average  per  position  68.20  100 

Primacy  and  recency  both  influence  recall  memory.  The  influ- 
ence of  each  on  recognition  is  less  than  on  recall,  but  is  greater  for 
material  devoid  of  associations  and  less  for  material  rich  with  asso- 
ciations. 

4.  Variations  in  Size  <md  Color 

Peterson  (15)  studied  the  influence  of  complexity  and  dissimi- 
larity on  memory.  Among  other  interesting  facts,  he  determined 
the  effect  of  variations  in  size  and  in  color  for  recall.  His  results 
suggest  the  questions : 

4.  What  is  the  influence  of  variation  in  color  on  recall  and  on 
recognition  f 

5.  What  is  the  influence  of  variation  in  size  on  recall  and  on 
recognition  t 
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inch,  eight  %  inch,  eight  1-inch,  four  1%  inch.  It  is  difficult  to 
secure  material  absolutely  devoid  of  meaning,  for,  as  Morton  Prince 
has  said,  "Even  nonsense  syllables  have  the  meaning  nonsense."1 
The  materials  used  in  this  part  of  the  experiment  were  almost  en- 
tirely devoid  of  associations.  No  syllable  was  repeated;  the  series 
were  so  devised  that  no  syllable  in  red  had  the  letter  R  in  it,  no  syl- 
lable in  yellow  had  a  Y,  none  in  blue  had  a  B,  nor  had  any  in  green 
a  6.  None  of  the  letters  in  one  syllable  appeared  in  the  next  syllable 
in  the  series.  All  the  letters  were  capitals;  the  use  of  capitals  made 
the  syllables  more  nonsensical  and  less  easy  to  associate. 

The  presentations  to  Groups  C  and  D  resembled  those  made  to 
Groups  A  and  B  respectively.  The  recognition  series  differed;  to 
Groups  C  and  D  the  recognition  sets  were  always  standard,  i.e.,  black 
size  %  inch.  The  records  for  all  groups  are  given  in  Table  X.  It 
will  be  noticed  that  the  recall  records  for  Groups  A  and  C  and  for 
Groups  B  and  D  respectively  can  be  combined. 

Peterson  writes  "In  immediate  recall  the  series  varying  in  size 
gave  slightly  better  results  than  the  standard — a  gain  of  9  per  cent, 
but  that  color  variation  was  of  no  aid."    His  table  shows: 

Immediate  Recall 

Average  for  standard 6.31  M.V.  1.15 

Average  for  color  variation  6.35  M.V.    .74 

Average  for  size  variation  6.89  M.V.    .68 

The  results  of  the  present  experiment  show : 

Immediate  Recall  (40  Subjects) 

Average  for  standard 2.70  M.V.  1.22 

Average  for  color  variation  2.58  M.V.  1.02 

Average  for  standard 2.63  M.V.  1.25 

Average  for  size  variation 2.75  M.V.  1.23 

Tables  X.,  XI.  show  the  results  for  both  recall  and  recognition. 
Color  variation  does  not  increase  the  amount  recalled  or  recognized 
so  far  as  these  experiments  are  concerned.  The  variation  in  size  of 
the  syllables  does  not  affect  recall  or  recognition.  Color  and  size 
variation,  as  such,  present  in  this  meaningless  material,  did  not  in- 
fluence either  recall  or  recognition. 

In  the  study  of  the  possible  influences  which  these  factors  might 
have  upon  recall  and  recognition  no  characteristic  differences  be- 
tween the  processes  are  noticed.  A  factor  which  may  have  shown  a 
tendency  to  influence  recall  in  one  way  showed  the  tendency  in  the 
same  direction  for  recognition,  although  the  extent  or  degree  of  the 
influence  may  have  differed.  To  study  the  relation  of  the  processes 
in  different  materials  and  among  different  groups  of  subjects  was 
the  purpose  ot  the  experiments  discussed  in  the  toWoVm^  <&k$\&ku 
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TABLE  X 

RECALL 


All 19 

B    L 27  46 

C  II 31 

D    1 31  62 

Total  (40  subjects)  ...77.108 

Average    2.70 

M.V 152 


A    I.  color 25 

B  n.  color 23    48 

C    I.  color 26 

D  II.  color 29     55 

~  103 
2.58 
1.02 


Recognition 


A  n. 

B    I. 


100 
114 


C  II 104 


214 


D    1 119    223 

Total  (40  subjects) .  .777 .  437 

Average    10.93 

M.V 1.34 

Presented  in  black,  recognition  in  black 
Presented  in  color,  recognition  in  color 
Presented  in  color,  recognition  in  black 


A    I.  (color) 113 

B  II.  (color) 103     216 

Average  (20  subjects) ....     10.80 

M.V 1.34 

C    I.  (pre.  color)  . .  108 

D  II.  (pre.  color)  . .  105    213 

Average    10.65 

M.V.    1.07 

Av.  10.93  (40  subjects) 

.  Av.  10.80  (20  subjects) 


Av.  10.65  (20  subjects) 


A  III. 
B   IV. 

c  in. 

D  IV. 


(size) 
(size) 

(size) 
(size) 


28 
25 

28 
29 


TABLE  XI 
Recall 


53 


57 


Total  (40  subjects) 110 

Average    2.75 

M.V 1.23 


A  IV. 

b  in. 

c  IV. 

d  m. 


29 
23 

21     — 
32    53 

—  105 

2.63 
1.25 


208 


Recognition 

A  in.  (size) 110  4  IV 106 

B  IV.  (size)   109  B  Ul 102 

Total  (20  subjects)  .  777    219 

Average 10.95 

M.V 97 

C  in.  (pre.  size)  . .  107 
D  IV.  (pre.  size)  . .  110 

Total  (20  subjects)  .77    217 

Average 10.85 

M.V 1.30 

Presented  in  standard,  recognition  set  standard At.  10.68 

Presented  in  variation,  recognition  set  standard At.  10.85 

Presented  in  variaftoa,  TOagofttan.  «&  TOrUttoa At.  10.95 


C  TV 

DIE 

Total  (40  subjects) 
Average 


109 
110 


219 

427 
10.68 


CHAPTER  IV 

-*  . j    ■  « 

t 

Methods  and  Procedure 

1.  Materials 

The  foregoing  experiments  seem  to  indicate  that  the  degree  of 
difference  between  recall  and  recognition,  when  different  factors  are 
present,  varies  with  the  material  used.  In  general,  if  there  is  any 
noticeable  difference  in  the  influence  of  a  factor  on  recall  and  recog- 
nition, it  is  greater  for  material  rich  with  association.  In  the  pres- 
ent study  four  kinds  of  materials  are  used ;  words,  geometrical  forms, 
proverbs,  and  nonsense  syllables.  There  are  twenty-five  items  of 
each  material  in  the  presentation  series  and  fifty  in  the  recognition 
series.  The  words  are  all  simple  nouns — hand,  chicken,  letter,  coal, 
umbrella,  kite,  etc.  The  forms  are  similar  to  those  employed  by 
"Whitley  and  later  by  Simpson.  Proverbs  were  collected  for  several 
months  before  the  experiment  was  begun,  by  noting  all  the  proverbs 
seen  or  heard  and  by  reference  to  collections  of  proverbs.  It  was 
desired  to  have  all  the  proverbs  "reasonably  short' '  and  "about  the 
same  length" — i.e.,  the  proverb  must  take  only  one  line  on  the  card 
and  must  not  be  so  much  longer  than  the  one  above  or  below  it  to 
be  easily  recognized  on  the  recognition  blank  on  account  of  size.  The 
attempt  was  made  to  have  as  many  proverbs  that  might  be  familiar 
as  those  that  might  not  be  so  familiar  in  the  presentation  and  con- 
trol series.  Among  the  proverbs  used  are:  "Enough  is  as  good  as  a 
feast,"  "No  road  is  long  with  good  company,"  "Pleasing  everybody 
is  pleasing  nobody."  The  nonsense  syllables  used  have  three  letters, 
the  first  and  the  last  being  consonants  and  the  middle  one  a  vowel — 
zof,  dej,  zaf,  etc.  The  series  are  printed  in  small  letters  but  made 
as  devoid  of  associations  as  possible — none  of  the  letters  in  a  syllable 
appeared  in  the  syllables  above  or  below  it  in  the  list. 

There  are  two  presentation  series  and  two  recognition  series  for 
each  material,  except  words  for  which  there  are  four  series.  The 
items  for  each  material,  except  forms,  are  printed  in  a  single  column 
on  a  separate  card  in  type,  Eight  Point  Scotch ;  each  card  is  headed 
by  the  word  Words  or  Proverbs  or  Syllables  according  to  the  ma- 
terial. The  twenty-five  forms  are  printed  in  five  rows  of  five  items 
each  on  a  separate  sheet.  For  the  recognition  tests  fifty  items  of  each 
material,  twenty-five  being  the  same  as  in  the  presentation  series, 

25 
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the  meanings  of  "Recall  Score  5"  and  "Recall  Score  10,"  etc.,  are 
"5  items  recalled  correctly  out  of  25"  and  "10  items  recalled  cor- 
rectly out  of  25,"  etc.,  respectively. 

In  the  experiments  reported  in  the  foregoing  chapters  the  recogni- 
tion score  is  the  number  recognized  correctly  when  the  subjects  are 
required  to  select  a  certain  number  (number  originally  presented). 
This  method  has  been  criticized  adversely  because  it  is  thought  that 
the  "guessing"  factor  is  not  sufficiently  controlled.  Strong  (16) 
has  devised  a  formula, 

Correct  recognitions         Correct  recog.  —  Incorrect  recog.  v  -m 
Total  number  presented      Correct  recog.  +  Incorrect  recog. 

which  he  has  used  extensively  in  his  work  on  recognition  memory 
of  advertisements.  Myers  has  also  employed  Strong's  formula.  In 
explaining  his  formula  Strong  writes:  "There  are  three  factors 
which  must  be  taken  into  account  in  obtaining  a  fair  summary. 
There  is  first  the  number  of  advertisements  that  are  correctly  recog- 
nized— relationship  between  the  number  recognized  and  the  total 
number  that  should  be  recognized.  There  is  second  the  accuracy  of 
the  recognitions — the  relationship  between  the  number  of  correct  and 
the  number  of  incorrect  recognitions.  And  there  is  third  the  general 
scheme  of  the  experiment  In  this  experiment  the  subject  had  to 
select  from  an  equal  number  of  right  and  wrong  advertisements.  .  .  . 
Turning  now  to  the  first  factor  we  see  at  once  that  by  reducing  the 
total  number  recognized  to  per  cent,  of  all  that  should  have  been  seen 
we  can  compare  directly  the  results  from,  say,  a  series  of  5  advertise- 
ments with  results  from  other  series.  Such  comparison  is  expressed 
by  the  formula 

Correct  recognitions 
Total  number  presented 

In  presenting  the  second  factor  we  must  recognize  that  when  there  is 
an  equal  chance  of  selecting  a  right  or  wrong  advertisement  (when 
an  equal  number  of  each  are  presented  as  in  this  experiment)  a  rec- 
ord of  50  per  cent,  correct  recognitions  means  nothing  but  pure 
chance.  This  50  per  cent,  recognition  really  means  nothing  else  than 
zero  memory  for  although  the  subject  has  picked  out  x  advertise- 
ments correctly  from  the  n  advertisements  presented  originally  yet 
he  has  picked  out  an  equal  number  incorrectly  from  those  advertise- 
ments which  had  not  been  presented  to  him.  .  .  .  Perfect  memory, 
on  the  other  hand,  would  be,  of  course,  where  the  n  advertisements 
presented  were  all  recognized  and  none  of  the  wrong  advertisements 
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towards  an  answer  Yes  or  No  but  all  these  tendencies  can  be  divided 
into  two  classes.  Those  derived  from  the  presentation  or  from  the 
25  stimuli  originally  shown  and  those  derived  from  other  sources. 
The  tendencies  of  the  first  class  tend  always  toward  right  answers, 
while  those  of  the  second  class  tend  equally  toward  right  and  wrong 
answers.  Any  given  reaction  may  be  the  resultant  of  both  sorts  of 
tendencies,  but  in  the  long  run  the  effect  of  the  tendencies  of  the 
second  class  must  show  itself  by  producing  an  equal  number  of  right 
and  wrong  answers  and  therefore  a  measure  of  these  tendencies  can 
be  obtained  by  taking  twice  the  number  of  errors.  This  procedure, 
like  all  others  found  on  probability,  may  do  violence  to  the  fact  in 
the  single  case  but  comes  out  right  in  the  total. ' ' 

The  formula  cos  »  U  may  also  be  employed  to  determine  the  score 
for  recognition. 

Strong's  scores  are  presented,  on  a  per  cent,  basis,  a  perfect  score 
being  represented  by  100  and  the  lowest  score  by  0.  For  Woodworth 
the  scores  run  theoretically  from  the  total  number  of  possible  recogni- 
tions to  0.  With  the  cos  v  U  formula  the  scores  run  from  100  to  0. 
Thus  all  give  similar  scores  for  "all  right"  and  "all  wrong."  The 
following  examples  will  illustrate  the  differences  in  scoring. 


EXAMPLE  I 

Total  Number  or 

Items  in  Recognition  Series  10 

Total 
Zfumber 
of  Beeog. 

10 

Correct 
Beoog. 

10 

Iuoorreot 
Beoog. 

0 

Strong's 
Score          Step 

100           28 

Wood- 
worth's 
Score 

10 

Step 
2 

cobwU 
1.0000 

Step 
.0490 

10 

9 

1 

72 

24 

8 

2 

.9510 

.1421 

10 

a 

2 

48 

20 

6 

2 

.8089 

.2212 

10 

7 

3 

28 

10 

4 

2 

.5877 

.2788 

10 

6 

4 

12 

12 

2 

2 

.3089 

.3089 

10 

5 

5 

0 

0 

.0000 

Strong's  penalties  decrease  as  the  number  of  wrong  recognitions  in- 
creases, the  penalties  in  the  cos  v  U  formula  increase  as  the  number 
of  wrong  recognitions  increases,  while  Woodworth 's  penalties  remain 
the  same.  Thus  when  50  items  are  given,  suppose  X  gets  45  right 
and  5  wrong  and  Y  has  46  right  and  4  wrong,  the  difference  between 
X's  and  F's  scores  is  5.3,  but  if  M  gets  35  right,  15  wrong  and  N  34 
right  and  16  wrong  the  difference  in  their  score  is  3.5.  According 
to  Woodworth 's  formula  X's  score  is  40,  F's  42,  M 's  20,  JPs  18 ;  the 
difference  in  X's  and  Y's  score  is  the  same  as  the  difference  between 
Ml s  and  IV 's  scores,  2. 

Strong's  formula  is  based  on  the  argument  that  to  recognize  one 
more  after  having  recognized  45  correctly  is  more  difficult  than  one 
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The  possible  criticism  for  each  and  the  full  meaning  of  the  figures 
must  not  be  forgotten. 

The  coefficients  of  correlation  in  the  following  chapters  were  ob- 
tained by  the  statistical  method  explained  by  Woodworth  in  the 
Psychological  Review,  March,  1912,  Voi.  XVI.,  pages  97-123. 

3.  Groups  Tested  and  Procedure 

Two  groups  of  adults  were  tested,  in  one  there  were  twenty-eight 
women,  twenty-four  men;  in  the  other  twenty-four  women  and 
twenty  men,  making  ninety-six  persons. 

The  material  was  presented  in  the  following  order:  (Set  A) 
words,  geometrical  forms,  proverbs,  nonsense  syllables,  words;  (Set 
B)  words,  geometrical  forms,  proverbs,  nonsense  syllables,  words. 
To  the  subjects  in  the  group  of  fifty-two  adults  a  test  for  recall  mem- 
ory was  made  after  each  of  the  last  five  series  (Set  B).  The  tests 
were  given  separately  for  each  subject.  Each  subject  was  given  the 
following  written  directions: 

Yon  will  be  shown  different  kinds  of  material  and  afterwards  an  attempt  win 
be  made  to  determine  how  much  you  have  remembered.  The  material  will  vary — 
there  will  be  series  of  words,  of  forms,  of  proverbs,  and  of  syllables.  The  series 
will  always  be  the  same  length — 25  items.  Your  memory  will  be  tested  by  dif- 
ferent methods — sometimes  by  asking  yon  to  write  down  what  yon  remember,  and 
sometimes  by  showing  you  the  material  again  mixed  with  other  items  which  have 
not  been  seen  and  requesting  you  to  state  which  you  had  seen  and  which  you  had 
not  seen. 

The  time  given  to  read  the  presented  series  will  always  be  the  same— 50 
seconds.  In  order  that  you  may  have  some  idea  how  long  that  is,  before  the  ex- 
periment begins  a  picture  will  be  shown  for  50  seconds. 

Teachers,  business  men,  students,  housekeepers,  etc.,  were  among 
the  subjects,  most  of  them  were  undergraduate  or  graduate  students 
in  Columbia  University. 

Tests  for  recall  of  words,  recall  of  forms,  recall  of  syllables,  rec- 
ognition of  words,  recognition  of  forms,  recognition  of  syllables  were 
made  on  six  hundred  thirty-eight  children,  two  hundred  eighty-five  \ 
boys  and  three  hundred  fifty-three  girls  in  a  large  city  public  school.  / 
The  children  were  in  twenty-two  classes  in  the  ten  grades  44.,  4JB, 
5A,  5B,  6A,  6B,  1A,  IB,  8A,  8B.  Each  class  was  tested  as  a  group ; 
the  classes  were  mixed  so  that  the  boys  and  girls  were  tested  under 
the  same  conditions.  The  following  table  shows  the  number  of  girls 
and  boys  in  each  grade. 
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OtrH  Boyi 

4A   50  41 

4B   39  29 

5 A  47  39 

5B 30  41 

6A  36  26 

6B  37  22 

1A  11  25 

IB  31  22 

8^   34  21 

SB 38  19 

353  285 

The  following  directions  were  given  orally  to  each  group  tested: 

I  am  going  to  show  you  some  things  and  afterwards  find  out  how  much,  you 
can  remember.  Sometimes  I  shall  show  you  words,  sometimes  forms,  such  ma 
circle  or  a  square,  and  sometimes  nonsense  syllables — nonsense  syllables  always 
have  three  letters  put  together  in  such  a  way  that  they  do  not  make  sense. 
Sometimes  I  shall  find  out  how  much  you  can  remember  by  asking  you  to  write 
down  afterwards  how  many  you  remember  and  sometimes  by  showing  you  them 
again  mixed  with  some  that  you  have  not  seen  before.  There  will  always  be  25 
things  to  study  and  you  win  always  be  given  50  seconds  in  which  to  study  them. 
In  order  that  you  may  have  some  idea  how  long  that  time  is  I  shall  show  yon  a 
picture  for  50  seconds  before  we  begin. 

It  was  desired  to  give  the  children  some  idea  of  how  long  the 
period  of  fifty  seconds  is.  To  have  timed  empty  space  would  have 
caused  an  illusion  of  time  to  enter.  The  gazing  at  a  picture  served 
also  to  get  the  children's  attention  and  interest.  To  keep  the  condi- 
tions the  same  for  adults  a  picture  was  shown  to  them  too.  Each  sub- 
ject had  his  or  her  material  so  that  any  advantage  or  disadvantage 
due  to  his  or  her  position  in  the  room  might  be  avoided.  The  ma- 
terials were  kept  in  different  colored  envelopes. 

Nineteen  insane  persons  were  tested  each  separately.  The  results 
of  these  subjects  will  be  considered  in  Chapter  VI. 


CHAPTER  V1 

Relation  between  Memory  Processes;  Recall  and  Recognition 

1.  Comparison  of  Different  Series  of  the  Same  Material 

(See  charts  on  following  pages) 

It  has  been  stated  in  the  preceding  chapter  that  there  are  two 
sets  of  material.  Set  A  and  Set  B  complete  each  contain  a  series  of 
twenty-five  words,  twenty-five  forms,  twenty-five  proverbs,  twenty- 
five  syllables  and  a  second  series  of  twenty-five  words.    In  every  case 


TABLE  XII 

Bbt  A 

£3  Subjects 

Recall 
Words 

Recall 
Forms 

Recall 
Proverbs 

Recall 
Syllables 

Recall 
Words 

9.23 

6.17 

5.52 

3.44 

11.54 

AJ> 

2.80 

2.26 

1.39 

1.09 

3.31 

P.E 

33 

.27 
&BT  B 

.16 

.13 

.39 

44BubJ«rte 

8.27 

6.77 

5.52 

2.73 

9.59 

AJD 

2.41 

2.02 

1.64 

1.67 

2.66 

P.E 

31 

.26 
Bet  B 

.21 

.21 

.34 

M  Subject* 

Recog. 
Words 

Reooff. 
Forms 

Rseosj. 
Proverbs 

Rseosj. 
Syllables 

Reooff. 
Words 

32.52 

13.52 

33.12 

18.65 

33.46 

A.T) 

8.79 

5.21 

6.72 

6.56 

8.18 

P.E 

1.03 

.61 
Bsr  A 

.79 

.77 

.96 

44  Subject* 

29.68 

25.54 

34.14 

23.82 

33.59 

A  J) 

7.30 

6.68 

6.47 

6.64 

6.97 

P.E 

93 

.85 

.82 

.85 

.89 

Set  A  was  presented  to  the  subject  first  and  Set  B  second.  For  the 
group  of  fifty-two  adults  the  test  for  recall  was  made  for  Set  A, 
for  recognition  for  Set  B.  In  the  group  of  forty-four  adults  the 
recognition  test  was  made  for  Set  A  and  the  recall  test  for  Set  B. 

i  Borne  of  the  data  in  this  chapter  have  been  published  by  the  author  in 
"Tests  of  the  Memories  of  School  Children,"  Edith  F.  Mulhall,  Journal  of 
Bdmeational  Psychology,  Hay,  1917. 
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The  materials  in  Set  A  were  recognized  by  forty-four  adults  and  re- 
called fay  fifty-two  adults.  The  materials  in  Set  B  were  recalled  by 
forty-four  adults  and  recognized  by  fifty-two  adults.  Thus  one 
group  recalled  the  material  which  the  other  group  recognized.  In 
this  way,  one  might  see  whether  the  series  in  the  two  sets  were  about 
equally  difficult.  Table  XII.  shows  the  average,  the  average  devia- 
tion, and  the  P.E.  of  the  average  for  these  groups. 

The  different  series  of  the  same  material  appear  to  be  about 
equally  difficult.  In  each  case,  except  for  the  recognition  of  forms, 
the  difference  between  the  scores  is  small  and  the  deviation  fairly 
large.  More  words  in  Set  A  were  recalled  by  the  group  of  fifty-two 
than  in  Set  B  by  the  group  of  forty-four.  The  average  score  of  the 
second  series  of  words  is  slightly  higher  in  both  recall  and  recognition 
for  both  groups.  The  forms  in  each  set  seem  to  be  equally  difficult 
to  reproduce,  but  those  in  Set  A  harder  to  recognize.  This  is  prob- 
ably due  to  the  control  figures  being  more  confusing  and  more  like 
the  presentation  series  in  Set  A  than  the  control  figures  in  Set  B  are 
like  the  presentation  figures  in  Set  B. 

The  scores  for  recall  for  the  two  groups  have  been  combined  and 
the  scores  for  recognition  for  the  two  groups  have  been  combined 
giving  the  following  results  for  ninety-six  subjects. 

Words 

BecaU    8.75 

Beeog.   31.10 

2.  Recalling  and  Recognizing  of  the  Same  Material 

The  complex  question  concerning  the  relation  between  the  results 
obtained  by  testing  memory  by  recall  and  by  recognition  is  reduced 
to  several  simple  ones  which  are  stated  in  Chapter  II. 

The  first  inquires  about  the  relation  between  the  recalling  and 
recognizing  of  the  same  material.  Does  the  person  who  recalls  one 
kind  of  material  well  also  recognize  that  kind  of  material  well  f 

The  coefficients  of  correlation  between  recall  of  words  and  recog- 
nition of  words,  between  the  recall  of  forms  and  the  recognition  of 
forms,  between  the  recall  of  proverbs  and  the  recognition  of  proverbs, 
between  the  recall  of  syllables  and  the  recognition  of  syllables,  were 
calculated  for  the  two  groups  of  adults.  The  coefficients  of  correla- 
tion between  the  recall  of  words  and  the  recognition  of  words,  be- 
tween the  recall  of  forms  and  the  recognition  of  forms,  and  between 
the  recall  of  syllables  and  the  recognition  of  syllables  by  the  children 
were  computed  for  each  grade.  Table  XIII.  gives  these  coefficients 
of  correlation. 


Forma 

Proverbs 

Syllable* 

Word* 

6.47 

5.55 

3.09 

10.57 

•  •  • 

33.63 

21.24 

33.53 
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TABLE  Xm 

Re.  Set  4  Be  Bat  A 

Adulte  Be  Set  B  Re.  Set* 

Beeall  Words  Beeog.  Words .24  .18 

BeesU  Forms  Beeog.  Forms — .18  — .10 

Beeall  Proverbs  Beeog.  Proverbs M  — .08 

Beeall  Syllables  Beeog.  Syllables .32  .74 

Beeall  Words  Beeog.  Words 24  .84 

Average   .21  .25 

Beeall  Words  Beeog.  Words,  corrected  by  at- 
tenuation   75  .52 

Children  iA      AB      &A      &B      *A  tB      7A      7B      SA      &B     At. 

Beeall  Words  Beeog.  Words . .  .19  .18  .38  .52  .23  .00  .10  .22  .44  .44  .25 
Beeall  Forms  Beeog.  Forms  . .  .84  28  .00  .00  .42  —.10  .82  .12  .22  .84  .21 
Beeall  6yL  Beeog.  8yL 34    .18    .34    .00    .22        .14    .12    .10  .00    .17 

If  the  coefficients  had  been  near  — 1.00  it  would  have  indicated 
that  those  who  recalled  well  recognized  poorly  and  if  the  coefficients 
had  been  1.00  it  would  have  indicated  that  those  who  recalled  well 
recognized  welL  The  coefficients  are  low ;  the  average  (without  cor- 
recting for  attenuations)  for  the  adult  group  being  .23,  for  children 
.21  with  a  large  P.E.  Coefficients  corrected  for  attenuation  are 
higher.  Before  drawing  any  conclusions  from  these  data,  an  exam- 
ination of  the  following  tables  may  be  made. 
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Along  the  horizontal  line  are  represented  the  scores  for  recall,  along 
the  vertical  are  the  scores  for  recognition.  The  numbers  in  the 
diagram  represent  the  number  of  children  who  had  the  different 
score,  thus  four  persons  with  the  score  of  5  for  recall  of  words  had 
the  score  of  48  for  recognition,  two  persons  with  the  recall  score  of  5 
had  recognition  score  for  words  of  46. 

The  tables  show  the  recall  and  recognition  scores  for  all  the  chil- 
dren. If  the  correlation  between  recall  and  recognition  were  great — 
i.e.,  if  the  children  who  recalled  well  recognized  well,  most  of  the 
eases  would  lie  along  the  diagonal  from  the  upper  left  side  to  the 
lower  right  side,  and  if  there  is  a  negative  correlation,  most  of  the 
cases  would  lie  along  the  other  diagonal,  from  upper  right  side  to 
lower  left  side.  Neither  of  these  situations  occurs  in  any  cases— there 
is  no  high  positive  nor  negative  correlation.  In  the  recall  of  words 
twenty  children  have  a  score  of  over  eleven  and  in  recognition  thirty- 
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five  had  a  score  of  forty-two  or  over,  but  only  one  of  the  twenty  is 
in  the  group  of  thirty-five.  The  best  scores  for  recall  are  17, 15, 15, 
14  and  the  recognition  scores  for  these  subjects  are  respectively  24, 
34,  34,  40.  The  best  scores  for  recognition  are  50,  48,  48,  48,  48, 48, 
48,  48,  48,  48,  48,  and  the  recall  scores  for  the  subjects  having  these 
scores  or  respectively  9, 13,  9,  9,  7,  6,  5,  5,  5,  5,  3.  The  seven  worst 
scores  for  recall  are  all  one  (1)  and  the  recognition  scores  of  these 
subjects  44,  40,  24, 16, 14,  6,  2.  In  the  test  for  forms  four  children 
had  a  recall  score  of  10  or  over  and  six  a  recognition  score  of  30  or 
over.  None  of  the  four  is  among  the  six.  The  best  scores  for  recall 
are  11,  10,  10,  10,  and  the  subjects  with  these  recall  scores  had  the 
following  scores  for  recognition,  10, 12, 10,  8  respectively.  The  best 
scores  for  recognition  of  forms  are  38, 32, 32, 30,  30, 30  and  the  recall 
scores  of  the  same  subjects  are  respectively  6,  7, 4,  7,  6,  5.  The  three 
subjects  with  zero  scores  for  recall  of  forms  were  among  the  113  sub- 
jects who  had  4  or  less  for  their  recognition  scores. 

In  the  test  for  syllables  three  children  have  the  recall  scores  8,  9, 
9 ;  their  recognition  scores  are  40, 10,  2  respectively.  The  three  best 
recognition  scores  are  40, 40, 44  and  the  recall  scores  of  the  same  sub- 
jects 8, 3, 0,  respectively.  Those  with  recognition  scores  below  4  have 
recall  scores  ranging  from  9  to  0;  recall  scores  of  zero  have  high  and 
low  recognition  scores. 

From  the  coefficients  of  correlation  and  from  the  tables  one  finds 
no  very  high  negative  nor  positive  correlation.  These  data  would 
indicate  that  a  person  who  recalls  a  certain  material  well  may  recog- 
nize that  kind  well,  fairly  well,  or  poorly — we  know  little  about  one's 
recognition  memory  from  a  test  of  recall.  There  is  a  strong  tendency, 
in  general,  for  the  correlation  to  be  positive  rather  than  negative. 
The  grade-groups  of  children  on  the  average  do  not  differ  from  the 
groups  of  adults  in  degree  of  correlation  any  more  than  the  different 
grade-groups  of  children  differ  among  themselves.  There  is  no 
marked  increase  in  degree  of  correlation  from  grade  to  grade.  Ex- 
cept for  the  low  correlation  among  adults  for  forms,  there  is  no  con- 
sistent difference  in  degree  of  correlation  between  recall  and  recogni- 
tion material. 

3.  Recall  of  Different  Materials 

Earlier  investigators  have  shown  that  those  who  recall  one  kind 
of  material  well  may  not  recall  another  kind  well.  The  present  re- 
sults may  be  examined  for  a  confirmation  or  contradiction  of  their 
conclusion.  The  coefficients  of  correlation  between  the  recall  of  words 
and  recall  of  forms,  between  the  recall  of  words  and  the  recall  of 
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coefficients  for  recall  between  different  materials  in  Set  B  are  positive 
and  the  total  of  positive  coefficients  is  .52  and  the  negative  28. 
Eighteen  of  the  twenty-eight  coefficients  among  the  groups  of  chil- 
dren for  recall  of  different  materials  are  positive ;  the  total  of  positive 
coefficients  is  3.58  and  negative  .96. 

The  coefficients  of  correlation  for  recall  of  words  with  other  ma- 
terials average  for  Set  A  .61,  for  Set  B  .13 ;  the  coefficients  of  corre- 
lation for  recall  of  forms  with  recall  of  other  material  is  for  Set  A 
.31,  for  Set  B  .01 ;  the  coefficients  for  recall  of  proverbs  with  the  re- 
call of  the  other  materials  for  Set  A  .25,  for  Set  B  .01 ;  the  coefficients 
for  recall  of  syllables  with  recall  of  other  materials  is  for  Set  A  .19, 
for  Set  B  .03.  The  average  of  the  coefficients  of  recall  of  words  with 
recall  of  forms  and  recall  of  syllables  among  children  is  .095,  recall 
of  forms  with  recall  of  words  and  recall  of  syllables  is  .07,  recall  of 
syllables  with  recall  of  words  and  recall  of  forms  .12. 

There  is  little  difference  in  materials — the  coefficients  for  all  are 
low  and  the  P.E.  large,  with  the  exception  of  recall  of  words  with 
recall  of  other  materials  in  Set  A  by  the  adults.  From  the  results 
among  the  adults  it  might  appear  that  words  are  a  better  index  of 
one's  recall  memory  than  the  other  materials,  but  the  children's 
records  do  not  indicate  this. 

4.  Recognition  of  Different  Materials 

Does  the  person  who  recognizes  one  material  well  recognize  an- 
other well  f 

The  coefficients  of  correlation  between  recognition  of  different 
materials  for  both  groups  of  adults  and  for  each  grade  of  school 
children  are  given  in  Table  XVI. 

The  average  of  the  coefficients  of  correlation  between  the  recogni- 
tion of  different  materials  in  Set  A  is  .37  and  for  Set  B  .28.  The 
average  of  the  coefficients  of  the  grade-groups  of  children  is  .18. 

The  coefficients  vary,  but  there  is  a  tendency  for  them  to  be  posi- 
tive rather  than  negative.  Five  of  the  six  coefficients  between  recall 
of  the  different  materials  in  Set  A  and  in  Set  B  are  positive.  In 
Set  A  the  total  of  the  positive  coefficients  is  2.26,  the  negative  .01; 
in  Set  B  the  total  of  the  positive  is  .78,  negative  .12.  Twenty-three 
of  the  twenty-eight  coefficients  of  correlation  between  recognition  of 
different  materials  are  positive ;  the  total  of  the  positive  coefficients  is 
5.32  and  the  negative  .16. 

The  average  of  the  coefficients  of  correlation  for  recognition  of 
words  with  other  material  in  Set  A  is  .33,  in  Set  B  .42 ;  for  recogni- 
tion of  forms  with  other  material  in  Set  A  .25,  in  Set  B  .15 ;  for  rec- 
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for  recall  is  words,  then  forms  and  proverbs,  and  the  worst  score  is 
for  syllables,  for  both  groups  of  adults.  For  recognition  the  order 
of  the  scores  from  highest  to  lowest  is  proverbs,  words,  forms  and 
syllables,  and  is  the  same  for  both  groups.  Syllables  are  the  hardest 
material  to  recall  and  to  recognize.  Words  are  recalled  well  and  also 
recognized  well,  but  proverbs  are  the  easiest  recognized. 

Some  of  the  adults  tested  were  asked  to  give  their  introspections. 
These  show  that  for  all  the  materials  the  subjects  tried  to  associate 
the  items,  sometimes  one  item  with  another  and  sometimes  with  an 
experience  outside  of  the  presented  series.  Many  of  the  subjects 
visualized  the  items  or  tried  to  remember  the  sound  of  them.  Re- 
cency, primacy,  familiarity,  likes  and  dislikes  all  served  as  aids.  The 
introspective  accounts  are  similar  for  the  different  materials,  and 
for  recall  and  recognition,  but  different  among  different  subjects. 

The  degree  to  which  the  method  or  means  of  remembering  is  suc- 
cessful depends  upon  the  material — it  is  more  difficult  to  form  asso- 
ciations for  syllables  than  for  words.  It  appears  that  the  material 
with  the  greatest  number  of  associations  is  best  remembered.  In  the 
tests  for  words  one  can  form  associations  with  other  words  or  with 
outside  experiences,  visualize,  or  imagine  the  sound;  the  word  can 
be  remembered  as  a  single  item,  not  each  letter  separately.  In  some 
cases,  the  forms  might  be  named  but  often  by  a  phrase  rather  than  a 
word,  they  could  be  visualized,  but  few  associations,  either  between 
them  or  with  outside  experiences  can  be  made,  and  often  separate 
lines  in  the  form  have  to  be  remembered  instead  of  the  form  as  a 
single  item.  The  proverbs  are  familiar  material,  but  are  remembered 
for  their  "idea"  more  than  word  for  word  and  hence  are  easily 
recognized  but  not  so  easy  to  recall.  The  syllables  have  the  fewest 
associations  and  are  most  difficult  to  recall  or  recognize. 

6.  Sex  Differences  in  Achievement 

In  examining  sex  differences  every  attempt  was  made  to  exclude 
other  factors,  or  to  keep  them  constant,  which  might  influence  the 
scores.  It  has  been  suggested  that  in  many  experiments  on  sex  dif- 
ferences unequal  numbers  of  each  sex  have  been  subjects  and  com* 
parisons  might  be  fairer  if  the  same  number  of  each  sex  were  tested. 
Equal  numbers  of  men  and  women  are,  therefore,  in  each  of  the  adult 
groups  compared.  They  were  selected  at  random  from  the  subjects 
which  were  graduate  and  undergraduate  students  in  Columbia  Uni- 
versity. There  are  not  equal  numbers  of  boys  and  of  girls  in  the 
grade-groups  of  children.  To  have  taken  equal  numbers  of  boys  and 
of  girls  in  each  grade  would  have  reduced  the  number  of  subjects  in 
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each  grade.    The  number  of  girls  and  of  boys  in  each  grade  may  be 
seen  by  referring  to  Table  XV.  on  page  42. 

table  xvn 

Bex  Ddtbrsncs  in  Recall  and  Recognition 
Group  of  tO  Women — Recognition  Bet  A,  Becatt  B 


See  chart  on  opposite  page. 


Recognition 


Worda 

Forms 

Proverbs 

Syllables 

Wocdi 

Wordi 

Form 

Proverb* 

Syllables 

Words 

Total  ... 

.  180 

132 

123 

53 

208 

660 

536 

683 

493 

732 

AT ■     .... 

9.00 

6.60 

6.15 

2.65 

10.40 

33.00 

26.80 

34.15 

24.65 

36.60 

M.V  ...( 

2.30 

1.99 

1.45 

1.74 

2.61 

8.30 

5.39 

6.28 

6.65 

7.14 

A  .£ 

.44 

.37 

.27 

.33 

.50 

1.37 

1.02 

1.18 

.26 

1.35 

Range  .. 

.      4-19 

3-13 

2-9 

0-7 

5-20 

18-48 

16-34 

12-48 

0-38 

22-48 

Group  of  tO  Men— Recognition  Bet  A,  BeoaU  Bet  B 


Recall 
Word!       Form     Proverbs    Syllables    Words 


Reoocnltloa 
Words       Forms     Proverbs    Syllables     Words 


Total   ... 

150 

129 

102 

61 

176 

550 

493 

684 

467 

616 

At 

7.50 

6.46 

5.10 

3.05 

8.80 

27.50 

24.65 

34.20 

23.35 

80.80 

JflLV*     •  •  • 

2.25 

2.05 

1.07 

1.32 

2.29 

4.25 

7.70 

6.45 

6.78 

6.28 

l  -  *^-*-    •  •  •  • 

.43 

.39 

.32 

.27 

.43 

.80 

1.46 

1.22 

1.28 

1.19 

Range  ... 

a-15 

2-10 

1-4 

0-7 
TA1 

5-17 

10-44 

6-40 

22-42 

8-38 

16-50 

BLE  XVUL1 

Group  of  tO  Women— BecaU  Bet  A,  Recognition  Bet  B 

Recall 

Reoognltloz 

i 

Words 

Forms 

Proverbs 

Syllables 

Words 

Words 

Forms 

Proverbs 

Syllables 

Words 

Total   ... 

217 

137 

122 

80 

274 

712 

295 

675 

406 

738 

At 

10.35 

6.85 

6.10 

4.00 

13.70 

35.60 

14.75 

33.75 

20.30 

36.90 

JbL*  V.     •  •  • 

3.33 

1.95 

1.34 

1.20 

2.81 

9.74 

5.05 

6.35 

8.08 

7.01 

f^*Xai«            •     •     •     • 

.64 

.37 

.25 

.23 

.53 

1.84 

.95 

1.20 

1.51 

1.33 

Range  .. . 

4-18 

4-12 

4-9 

2-9 

8-20 

17-48 

4-24 

22-44 

6-44 

24-48 

Group  of  tO  Men— Recall  Bet  A,  Recognition  Bet  B 


Recall 


Reeoffnltton 


Words 

Forms 

Proverbs 

Syllables 

Words 

Words 

Forms 

Proverbs 

Syllables 

Words 

Total  .. 

.  158 

149 

98 

65 

204 

589 

258 

642 

340 

598 

AV.     .... 

7.90 

7.45 

4.90 

3.25 

10.20 

29.45 

12.90 

32.10 

17.00 

29.90 

M.V.    .. 

2.41 

2.36 

1.41 

.83 

2.94 

7.50 

5.10 

6.10 

5.60 

7.94 

jr.h*.   . . .  < 

.46 

.45 

.25 

.16 

.56 

1.42 

.96 

1.20 

1.59 

1.50 

Range  .. 

.      3-14 

&-12 

3-7 

1-6 

3-16 

12-48 

0-26 

22-48 

2-32 

22-40 

48     MZPXMIMXNTAL  8TUDIB8  IN  RECALL  AND  RECOGNITION 

The  scores  of  the  boys  and  of  the  girls  are  given  in  the  following 
table. 


At.  !€.▼.  FJB. 

44  4J2  136  M 

4B  4.41  139  30 

64  5.18  138  31 

SB  ......  5.66  1.44  .19 

64  546  132  .30 

SB  636  138  .23 

74  6.48  2.02  34 

IB  8J8  138  34 

64  636  136  30 

8ff  6.63  135  35 

At.  M.T.  FJB. 

44  832  130  J7 

4ff  3.60  1.40  33 

54  436  1.47  30 

SB  430  1.61  31 

64  4.42  1.46  34 

SB  537  135  32 

74  5.08  .85  .14 

IB  633  139  31 

84  5.43  133  34 

SB  5.63  1.18  33 

Bon 

At.  U.r.  FJB. 

44  134  34  .12 

4B  131  .71  Jl 

54  1.74  1.43  .10 

SB  237  130  J8 

64  131  .76  J7 

6B  1.86  33  .17 

74  234  .60  .10 

IB  3.00  U8  33 

8B  234  132  34 


TABLE  XIX 

AT. 

430 

am 

M.V. 

1.41 

FJB. 

J7 

AT. 

20O5 

Bays 
M.V. 
832 

FJB. 

1.18 

At. 

2336 

M.T. 

8.14 

FJB. 

.37 

533 

1.73 

33 

14.70 

8.64 

135 

2332 

931 

134 

5.64 

1.75 

32 

23.74 

9.17 

134 

28.19 

031 

105 

5.60 

134 

34- 

2338 

834 

1.18 

26.73 

7.64 

108 

6.08 

137 

36 

2938 

938 

137 

2832 

036 

130- 

6.40 

130 

.19 

2435 

8.05 

1.45 

35.04 

730 

1.05 

736 

1.67 

.42 

2702 

8.46 

1.43 

32.73 

735 

137 

7.45 

2J2 

32. 

24.04 

6.15 

iai 

3131 

836 

134 

8.00 

135 

38 

29.62 

7.01 

130 

2834 

030 

1.48^ 

7.76 

131 

30 

27.68 

034 

131 

3239 

634 

35 

At. 

430 

li.T. 

1.41 

FJB. 

ao 

At. 

736 

li.T. 

638 

33 

AT. 

8J6 

M.T. 

538 

FJB. 

.71 

333 

1.00 

.15 

8J0 

630 

1.03 

536 

630 

33 

4.15 

138 

.16 

1105 

6.02 

31 

031 

5.47 

.67 

4.00 

130 

31 

0.73 

6.10 

32 

833 

4.73 

32 

435 

1.40 

30 

1138 

438 

33 

13.47 

6.73 

35 

532 

138 

32 

1036 

630 

1.13 

1432 

5.64 

.78 

435 

130 

.46 

8.36 

3.43 

38 

8.09 

436 

1.09 

5.77 

1.67 

35 

9.77 

5.16 

33 

10.48 

5.50 

33 

538 

1.57 

33 

12.14 

6.63 

1.01 

11.71 

6.71 

37 

534 

130 

31 

14.61 

539 

1.14 

11.48 

634 

37 

•bkm 

At. 
2.00 

GMi 
M.V. 

134 

FJS. 

.15 

At. 

635 

Bay* 
M.V.       FJE.             At. 

6.10      .81          8.62 

i 

Gtrit 
M.V. 

702 

FJB. 

35 

132 

1.00 

.15 

2.45 

6.19 

37 

1036 

637 

39 

133 

1.17 

.14 

7.34 

631 

34 

10.68 

630 

.78 

2.10 

1.13 

.17  - 

938 

730 

38 

9.60 

6.99  : 

10.08 

2.41 

134 

ao 

15.S1 

6.45 

1.07 

15.83 

6.44  1116 

231 

1.13 

.16 

11.41 

430 

.88 

13.19 

6.33 

138 

2.64 

1.03 

36 

1134 

6.S7 

1.16 

1235 

6.96 

1.77 

2.55 

134 

32- 

1032 

6.17 

1.11 

14.06 

833 

136 

5.37 

2.70 

37 

10.79 

7.04 

136 

16.71 

7.12 

38 

For  the  recall  records  the  men's  scores  are  7.50,  8.80,  7.90,  10.20 
and  the  women's  9.00,  10.40,  10.35,  13.70.  The  women  appear  to 
recall  words  better  than  the  men.  For  the  recognition  of  words  the 
men's  scores  are  27.50,  30.80,  29.45,  29.90  and  the  women's  33.00, 
36.60,  35.60,  36iM),  the  scores  of  the  women  are  higher.  In  the  tests 
for  recall  of  forms  the  average  scores  for  the  men  are  6.45,  7.45,  and 
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for  the  women  6.60,  and  6.85;  for  recognition  the  men's  average 
scores  are  24.65  and  12.90  and  the  women's  26.80  and  14.75.  For 
recall  of  forms  men  in  one  group  on  the  average  are  superior  and 
women  in  the  other  group,  for  recognition  of  forms  women  in  both 
groups  are  superior.  The  men's  average  scores  for  recall  of  proverbs 
are  5.10  and  4.90  and  the  women 's  6.15  and  6.10 ;  for  recognition  of 
proverbs*  men  34.20,  32.10,  women  34.15,  33.75— a  superiority  for 
recall  of  proverbs  among  women  but  little  difference  for  recognition. 
In  the  tests  for  recall  of  syllables  men's  average  score  are  1.32  and 
3.25  and  the  women's  1.74  and  4.00;  for  recognition  of  syllables  for 
men  23.35  and  17.00,  for  women  24.65  and  20.30. 

Among  the  adults  tested  the  women  appear  to  be  superior  to  the 
men,  on  the  average.  The  tendency  for  the  women's  scores  to  be 
higher  is  greatest  in  the  scores  for  recall  and  recognition  of  words 
and  in  the  recall  of  proverbs.  The  P.E.  of  each  average  is  given  in 
the  table. 

In  the  table  for  children,  girls  are  superior  to  boys  six  times  out 
of  ten  for  the  recall  of  words.  If  one  averages  the  averages,  boys 
have  5.96  and  the  girls  6.41  or  there  is  a  difference  of  .45  in  favor  of 
the  girls.  Girls  are  superior  to  boys  eight  out  of  ten  times  for  recog- 
nition of  words,  and  the  average  of  the  averages  for  boysf  is  24.49  and 
for  girls  29.07  or  a  difference  in  favor  of  the  girls  of  4.58.  For  recall 
of  forms,  girls  are  superior  to  boys  two  times  out  of  ten  and  aver- 
aging the  average,  boys  4.79,  girls  4.69,  the  boys  are  superior  by  .10. 
For  recognition  of  forms  girls  are  superior  four  times  out  of  ten  and 
averaging  the  averages,  boys  10.37,  girls  10.11,  the  boys  are  superior 
by  .26.  Girls  are  superior  to  boys  seven  times  out  of  nine  for  recall 
of  syllables  and  averaging  the  averages,  boys  2.09,  girls  2.55,  the  girls 
are  superior  by  .46.  In  the  recognition  of  syllables  girls  are  superior 
to  boys  eight  times  out  of  nine  and  in  the  average  of  the  averages, 
boys  9.59,  girls  12.61,  girls  are  superior  by  3.02.  To  summarize,  iiT) 
the  twenty-nine  recall  tests  girls  are  superior  seventeen  times  and  in  ' 
the  twenty-nine  recognition  tests  girls  are  superior  twelve  times. 
Little  or  no  sex  difference  is  present  for  recall  of  forms.  These  data 
show  a  tendency  for  girls  to  be  superior  to  boys  in  recall  and  in 
recognition  of  words  and  of  syllables.  -" 

Other  investigators  have  reported  superiority  of  girls  in  recall 
memory.  Chamberlain  (6),  however,  did  not  find  any  confirmation  • 
of  the  statement  in  his  results.  Any  difference  between  the  sexes 
which  exists  in  the  data  in  the  preceding  tables  is  present  for  recall 
and  recognition ;  the  difference  between  the  sexes  varies  with  the  ma- 
terial. No  apparent  sex  difference  seems  to  be  present  either  in 
achievement  in  recall  or  in  achievement  in  recognition. 
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pictures  were  of  monuments.  It  was  not  enough  to  remember  ' '  mon- 
ument. ' '  There  were  two  interiors  of  churches,  two  walls  with  Egyp- 
tian writing,  two  windmills,  two  bridges,  two  groups  of  people,  etc. 
The  average  score  of  right  responses  in  piles  1  and  2  is  12.30  for 
women  and  12.60  for  men ;  the  range  for  women  being  8  through  14 
and  for  men  10  through  15.  The  average  number  of  wrong  responses 
in  these  piles  for  women  is  1.35  and  for  men  .70.  The  subjects  were 
asked  to  introspect,  telling  why  they  choose  each  picture.  Both  the 
men  and  the  women  mentioned  details.  The  following  are  a  few  of 
the  ones  given:  (men)  "Trend  of  the  grass,' '  "Little  girl  standing 
by  river,"  "Side  view  of  this  bridge  different,"  "Cloud  effects," 
"Flag  near  top  of  this  monument,"  "Light  and  dark  trees"; 
(women)  "Dark  trees,"  "Grass,  twigs,"  "Figures  on  base,"  "Sky," 
"Long  aisle,"  "Sand  dunes,"  "Telegraph  pole  in  the  back."  The 
men  and  the  women  recognize  about  the  same  number  of  pictures  cor- 
rectly; the  women  incorrectly  select  more  than  the  men,  this  point 
will  be  discussed  in  Chapter  VII.    The  data  do  not  suggest  thaFl 

women  remember  more  details.  - ) 

Women  appear  to  remember  more  items  than  do  the  men  in  the 

memory  tests,  but  there  seems  no  evidence  that  this  is  because  they 

remember  more  details. 

7.  Sex  Difference  in  Variability 

Are  there  any  sex  differences  in  variability  among  the  adults  or 
among  the  children  in  the  recall  of  different  materials!  in  the  recog- 
nition of  different  materials  f 

In  Table  XXI.  the  average,  the  probable  error  of  the  average 
(PJB.),  the  Pearson  Coefficient  of  Variability  (P.C.)  and  the  range 
are  given  for  the  two  groups  of  men  and  for  the  two  groups  of 
women.  The  measure  of  variability  known  as  the  Pearson  coefficient 
is  the  gross  variability  divided  by  the  average. 

Among  the  twenty  Pearson  coefficients  seven  are  larger  for  the 
women.  Eight  of  the  twenty  P.E.  measures  are  higher  for  the 
women,  two  are  equal  for  both  sexes  and  ten  are  higher  for  men. 
The  range  indicates  the  lowest  and  the  highest  scores  in  the  group- 
Among  the  twenty  scores  representing  the  poorest  scores  in  the 
group  for  each  test,  two  are  lower  for  women  than  for  men  and  three 
are  the  same  for  both  men  and  women.  Eleven  of  the  twenty  best 
scores  in  each  group  for  each  test  are  higher  for  women,  in  five  cases 
the  highest  scores  are  the  same  for  men  and  for  women,  and  in  four 
cases  the  men 's  best  scores  are  higher  than  the  women 's  best  scores. 
No  sex  difference  in  variability  is  apparent  among  the  adult 
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TAOT.-R   XXII 

CHILDfiXN 

Bonn  Word* 
At.     P.B.      P.O. 

Bsosll  Forms 
AT.      P.E.      P.O. 

SsesJl  Syllsbks 
At.      P.X.      P.O. 

AA  B 

4.12 

.18    5301 

8.32 

J7 

5916 

1.54 

.12 

.6101 

G 

450 

.17    ,3279 

4.30 

.19 

5279 

2.00 

.15 

.6200 

4B  B 

4.41 

.20    .2925 

8.69 

53 

.3225 

151 

.11 

.4702 

G 

5.33 

.23    5246 

3.33 

.15 

5273 

152 

.15 

5789 

5A  B 

5.18 

.21    .3050 

4,26 

50 

5451 

1.74 

.19 

.8218 

G 

5.64 

.22    5103 

4.15 

.16 

5084 

1.83 

.14 

.6393 

SB  B 

5.66 

.19    5544 

4.59 

51 

.3508 
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MENTAL  STUDIES  IN  RECALL  AND 

of  the  nine  times  the  girls  are  hig 

for  both  sexes. 

ty-eight  measures  of  the  P.E.  twent; 

scores,  four  are  equal  for  both  boys  i 

greater  for  the  boys'  scores. 

nee  in  -variability  between  the  boys  ai 

arson  coefficient  or  the  P.E.  axe  us 

No  sex  difference  in  variability  in  these  tests  for  recall  and  for 
1  recognition  is  present  among  adult  nor  among  children. 

a    j«  TKffereHcet  m  RecoU  and  Recognition 

arence  in  recall  among  children  of  different  ages 
a  school t— in  recognition! 
are  the  averages  for  each  material,  words,  forma, 
ih  method  of  testing,  recall  and  recognition,  for 
.bar  of  children  in  each  age-group  is  also  given, 
isked  to  state  how  old  he  or  she  was  on  the  last 
this  birthday  was.  Since  all  children  eight  on 
nine  on  their  last  birthday,  etc.,  are  here  consid- 
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9        16.5        (6.11)         (5.11)         (1.43)  (24.56)        (9.11)        (6.67) 

8        17.5      (10.00)         (6.00)         (5.00)  (39.00)       (11.00)       (16.00) 

ered  "eight-year-olds,"  "nine-year-olds,"  etc.,  the  meaning  of  eight- 
year-olds,  nine-year-olds,  is  8.5,  9.5,  etc.,  in  this  report.  Further- 
more, all  eight-year-olds,  nine-year-olds  have  not  been  tested,  so  that 
the  averages  are  for  the  eight-year-olds,  nine-year-olds,  etc.,  who 
were  tested  in  the  grades  4A,  45,  5A,  5B,  6A,  65,  1A,  IB,  8A,  8B. 
There  is  a  marked  selection  in  the  case  of  eight-year-olds,  sixteen- 
year-olds,  and  seventeen-year-olds;  the  results  for  them  are  therefore 
given  in  parenthesis  and  are  not  included  in  the  diagram.    Only  flf- 
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teen  of  the  one  hundred  and  fifty-nine  in  the  fourth  year  (44.  and 
43)  are  eight  years  old,  most  of  the  children  of  that  grade  being  at 
least  nine  years  old.  Due  to  the  laws  permitting  children  of  fourteen 
who  have  reached  a  certain  grade  to  obtain  "working  papers,"  to 
the  fact  that  most  children  of  sixteen  and  seventeen  have  completed 
grade  82?,  and  to  other  causes,  only  eleven  children  of  sixteen  and 
seventeen  are  among  the  children  in  the  seventh  and  eighth  grades 
{1A9  IB,  8A,  8B). 

The  scores  for  recall  and  for  recognition  of  words  increase  grad- 
ually from  the  age  of  8.5  through  15.5.    In  general,  there  is  a  ten- 
dency for  improvement  with  age  for  recall  and  for  recognition  of 
forms  and  syllables  also.    The  improvement  with  age  may  be  seen 
by  comparing  the  average  of  the  averages  for  ages  9.5,  10.5,  11.5 
with  the  average  of  the  averages  for  ages  13.5, 14.5, 15.5.    The  aver- 
age of  the  average  scores  for  ages  9.5,  10.5,  11.5  for  recall  of  words 
is  5.22  and  the  average  of  the  average  scores  for  ages  13.5, 14.5, 15.5 
for  recall  of  words  is  7.22.    For  recognition  of  words  the  first  aver- 
age is  23.95  and  the  second  28.95.    For  the  recall  of  forms  the  scores 
are  3.97  and  5.42  respectively,  and  for  recognition  of  forms  9.61  and 
10.8.    In  the  tests  for  syllables  recall  averages  1.86  and  2.38  re- 
spectively and  for  recognition  9.41  and  13.11  respectively.    For  all 
materials  and  for  recall  and  recognition  the  scores  are  higher  for  the 
older  ages  than  for  the  younger  ones.    Both  recall  and  recognition 
scores  seem  to  improve  with  age. 

9.  Grade  Differences  in  Recall  and  Recognition 

Is  there  any  difference  in  recall  among  children  of  different  grade 
regardless  of  age  t — in  recognition  t 

In  Table  XXIV.  the  averages  are  given  for  each  material  in  each 
grade. 

TABLE  XXIV 

Reran  Words  Reran  Forma  Recall  Syllables 

Ay.  M.V.  At.  M.V.  Av.  M.V. 

4A   4.22  1.44  3.40  1.32  1.79  1.12 

AB 4.94  1.60  3.48  1.30  1.69  .89 

5A  5.43  1.67  4.15  1.28  1.79  1.28 

5B  5.63  1.49  4.33  1.53  2.20  1.28 

6A   5.92  1.87  4.73  1.46  2.16  1.23 

GB 6.44  1.35  5.24  1.55  2.08  1.03 

1A  7.03  1.92  4.97  1.69  2.36  1.19 

IB  7.75  2.00  5.96  1.48  2.74  1.30 

%A  7.62  1.93  5.40  1.48 

*B  7.39  1.77  5.37  1,41  3.07  1M 
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the  scores  for  the  recall  of  words  of  the  nine  year  olds  for  grade  4, 
of  the  eleven  year  olds  for  grade  5,  of  the  eleven  year  olds  for  grade 
6,  of  the  thirteen  year  olds  for  grade  7,  and  of  the  fourteen  year  olds 
for  grade  8,  the  total  score  of  those  who  are  in  a  grade  where  the 
median  age  is  their  age,  was  obtained.  By  dividing  this  total  by  the 
total  number  of  persons  whose  scores  have  been  added,  the  average 
score  for  the  children  who  are  in  a  grade  where  the  median  age  is 
their  age  is  found.  Then  the  scores  of  those  who  are  one  year,  two 
years,  etc.,  older  and  one  year,  two  years,  etc.,  younger  than  the  med- 
ian age  for  their  grade  may  be  computed.  Thus  the  tabulation  for 
the  recall  of  words  is : 
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CHAPTER  VI 
Memory  Tests  of  Insane  Patients 

Books  on  psychiatry  often  mention  memory  defects  among  insane 
patients.  Little  is  said  whether  the  defect  is  for  both  recall  and 
recognition. 

To  attempt  to  see  if  any  differences  in  recall  and  in  recognition 
could  be  observed  among  insane  patients,  the  tests  used  on  the  normal 
subjects  were  given  to  several  patients  in  a  hospital  for  the  insane. 
The  cases  will  first  be  considered  separately. 

Several  patients  known  as  Korsakoff's  were  tested. 

M-l  male,  adult,  exact  age  unknown.    Korsakoff  Disease. 

Recall  scores:  Words  12,  Forms  6,  Proverbs  2,  Syllables  0, 
Words  1. 

Recognition  scores:  Words  12,  Forms  6,  Proverbs  14,  Syllables  6, 
Words  6. 

The  patient  was  born  in  this  country  and  formerly  had  been  in 
business.  He  was  pleasant  and  cooperated  well  in  the  tests,  for  he 
was  anxious  to  leave  the  hospital  and  go  to  work.  The  picture  had 
been  shown  to  him  for  fifty  seconds  before  the  tests  were  made  so 
that  he  might  have  some  idea  of  the  length  of  the  period.  After  the 
ten  memory  tests  were  made,  the  examiner  asked  him  if  he  remem- 
bred  her  showing  him  a  picture.  He  did  not,  but  when  shown  the 
picture  again  he  said  he  remembered  having  seen  it  when  he  first 
came  into  the  room. 

The  examiner  showed  him  six  cards  (5  by  8  inches)  on  each  of 
which  was  pasted  an  object  (big  blue  B,  a  red  postage  stamp,  a  dish 
of  cereal,  man's  head,  baby  and  dog,  watch).  Each  card  was  shown 
for  two  seconds.  Immediately  afterwards  they  were  mixed  with  six 
more  cards,  each  having  a  picture.  He  was  asked  to  select  all  which 
he  had  seen.  He  recognized  the  first,  second,  third,  and  sixth,  a  total 
of  four.    He  asked  if  they  were  right. 

M-2  male,  age  62. 

Recall  scores:  Words  3,  Forms  1,  Proverbs  1,  Syllables  1,  Words  3. 

Recognition  scores:  "I  don't  remember  ever  having  seen  them." 

This  patient  when  examined  (1915)  had  been  in  the  hospital  for 
seven  years  but  did  not  know  how  long.  The  records  show  that  in 
1913  he  knew  he  had  come  in  1908.    The  patient  in  his  youth,  had 
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series,  the  last  two  on  the  list.  She  attempted  to  draw  the  forms  but 
only  made  a  mark  resembling  the  letter  H.  She  understood  the 
proverbs  and  recalled  two.  In  trying  to  recall  the  syllables  she  men- 
tioned several  combinations  of  letters,  bat  none  was  correct  After 
the  second  series  of  words,  she  mentioned  five  words,  but  only  one 
from  the  second  list,  one  from  the  first  list  and  three  which  had  ap- 
peared on  no  list  so  far  shown;  thus  her  response  was:  carriage, 
stove,  white,  pipe,  mirror.  For  the  recognition  tests  the  patient  saw 
the  material  and  answered  whether  or  not  she  had  seen  it  on  the  other 
list,  the  examiner  recording  the  reply. 

The  patient  cooperated  well.  She  was  sad,  however,  and  moaned. 
Before  the  test  materials  were  presented  she  was  shown  a  picture 
for  fifty  seconds.  Forty  minutes  later  she  was  asked  if  she  had  been 
shown  a  picture.  When  presented  again,  she  said  she  had  not  seen 
it  before.  She  pointed  out  several  objects  on  the  picture  indicating 
that  she  could  see  them. 

F-3  Female,  age  38.  Born  in  Ireland;  in  IT.  S.  about  16  years. 
Occupation  of  husband :  coachman.   Korsakoff. 

Recall  scores:  Words  5,  Forms  0,  Proverbs  0,  Syllables  0,  Words  3. 

Recognition  scores:  "No." 

During  the  examination  she  remarked  several  times  that  she  had 
never  had  any  schooling  because  she  had  to  work  out,  adding,  "It's 
a  sad  thing  indeed  to  have  no  schooling."  She  cried  frequently  be- 
cause she  was  so  happy,  saying,  "I  thought  I  was  in  the  bad  house 
but  I  came  to  myself  to-day  and  know  it's  not  the  bad  house."  She 
could  neither  read  nor  write  so  that  the  material  was  presented  audi- 
toriaUy.  She  recalled  three  words.  Although  she  could  not  write 
she  drew  two  figures,  but  they  were  not  like  those  shown.  The 
proverbs  seemed  familiar,  she  often  would  finish  one  in  chorus  with 
the  examiner.  She  could  recall  only  two.  The  syllables  could  not  be 
presented  in  a  satisfactory  manner.  She  recalled  three  words  from 
the  second  set  In  the  recognition  tests  she  would  say  "Yes"  or 
"I'm  not  sure  Ma'am." 

M-3  Male,  age  55.  Born  in  Germany,  in  U.  S.  20  years.  Occupa- 
tion: baker.    Alcoholic  psychosis. 

Recall  scores:  Words  4,  Forms  0,  Proverbs  0,  Syllables  0,  Words  3. 

Recognition  scores:  Words  22,  Forms  0,  Proverbs  0,  Words  15. 

The  patient  could  not  remember  the  doctor's  name  ten  minutes 
after  having  said  it  three  times.    He  said  the  forms  were  French. 

M-4  Male,  general  paralysis. 

Recall  scores:  Words  1,  Forms  2,  Proverbs  0,  Words  1. 
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M-10  Male,  age  63.  Arteriosclerosis.  Born  in  U.  S.  Common 
school  education ;  left  school  at  age  of  14.  Occupation  had  been  ma- 
chinist, grocer,  and  salesman. 

Recall  scores:  Words  3,  Forms  0,  Proverbs  4,  Syllables  0,  Words 
10. 

Recognition  scores:  Words  16,  Forms  8,  Proverbs,  Syllables  0, 
Words  10. 

He  remembered  the  picture  and  could  describe  it  twenty-five  min- 
utes after  having  seen  it.  He  recognized  five  of  the  six  cards  cor- 
rectly in  the  series  of  twelve. 

M-ll  Male,  age  53.  Arterio-eclerosia  Born  in  U.  S. ;  high  school 
education.  Occupation :  advertising  agent,  said  to  have  earned  $5,000 
a  year  as  secretary  to  a  publishing  house  at  one  time. 

Recall  scores:  Words  4,  Forms  2,  Proverbs  0,  Syllables  0,  Words  2. 

Recognition  scores:  Words  10,  Forma  4,  Proverbs  6,  Syllables  0, 
Words  12. 

He  remembered  and  could  describe  the  picture  thirty  minutes 
after  having  seen  it  for  forty  seconds.  He  also  selected  the  six  cards 
correctly  from  the  series  of  twelve. 

M-12  Male,  age  56.  Arterio-sclerosis.  Common  school  education. 
Occupation :  carpenter. 

Recall  scores:  Words  3,  Forms  0,  Proverbs  0,  Words  1. 

Recognition  scores:  Words  23,  Forms  4,  Proverbs  0,  Words  4. 

The  materials,  except  forms,  were  presented  verbally.  The  tests 
for  syllables  were  not  given. 

He  could  select  the  six  cards  correctly  from  the  series  of  twelve. 

A  few  eases  of  senile  dementia  are  described  below : 

F-5  Female,  age  79  or  84  (she  does  not  know) .  Senile.  Born  in 
Ireland;  in  U.  S.  60  years. 

The  material  was  presented  auditorially.  She  could  not  recall 
any  of  the  material  nor  could  she  recognize  any,  as  may  be  seen  by 
the  scores  for  recognition — Words  6,  Forms  2,  Proverbs  0,  Words  6. 

She  could  remember  nothing  in  the  picture  a  half  hour  after  it 
had  been  shown  to  her.  After  seeing  the  six  cards  mentioned  above 
she  selected  ten  among  the  twelve  as  those  previously  seen. 

F-6  Female,  age  81.  Occupation :  housework.  Religion :  Metho- 
dist   A  typical  *  'dear  old  lady. '  * 

She  could  not  see  well  enough  to  read  the  print  nor  hear.  The 
examiner  was  unable  to  conduct  the  experiment,  except  the  six  cards 
were  shown  and  afterwards  she  selected  four  from  the  series  of 
twelve. 
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in  the  first  and  second  sets  respectively  when  the  total  number  of 
responses  is  2,000. 

2.  The  Per  Cent  of  Wrong  Yeses  and  Bight  Yeses  Among  All  the 
Yeses  Used;  the  Per  Cent,  of  Wrong  Nos  and  Bight  Nos 

Among  AU  the  Nos  Used 

A  larger  number  of  Nos  are  wrong  than  Ysses.  This  might  be 
expected  since  more  Nos  are  used  than  Ysses.  This  is  true  for  each 
of  the  ten  tests.  The  amount  of  difference  varies  in  the  first  group 
from  130  to  230  and  in  the  other  from  86  to  177.  The  differences 
are  not  consistently  large  or  small  for  any  material.  The  greatest 
difference,  230,  between  the  wrong  Nos  and  wrong  Ysses  in  the  first 
group  and  the  least  difference,  86,  in  the  second  group  are  in  the 
tests  for  syllables. 

The  per  cent  of  wrong  Ysses  among  all  Ysses  used  and  the  per 
cent  of  wrong  Nos  among  all  Nos  used  are  given  in  the  table.  In 
each  of  the  ten  cases  the  per  cent,  of  wrong  Ysses  is  less  than  the  per 
cent  of  wrong  Nos.  The  difference  is  not  great;  it  varies  in  the 
second  group  from  .5  per  cent  to  15  per  cent  and  in  the  first  group 
from  4.5  per  cent  to  15  per  cent.  The  difference  in  the  first  group 
for  words  is  8.5  per  cent,  for  forms  4.5  per  cent,  for  proverbs  15.5 
per  cent  and  for  the  second  series  of  words  11  per  cent  In  the 
second  group  the  difference  for  words  is  4.5  per  cent,  for  forms  9  per 
cent,  for  proverbs  15  per  cent,  for  syllables  .5  per  cent,  and  for  the 
second  series  of  words  9  per  cent  The  difference  is  greatest  for 
proverbs  in  each  case.  In  the  first  group  the  per  cent  of  wrong 
Ysses  is  greatest  for  proverbs,  next  for  forms,  then  for  words,  and 
least  for  syllables-  In  the  second  group  the  order  is  proverbs,  words, 
syllables,  forms.  In  an  earlier  chapter  it  was  noticed  that  the  diffi- 
culty of  the  two  series  of  forms  is  not  the  same  for  recognition.  If 
the  forms  are  omitted  from  our  lists  here,  and  only  the  materials 
involving  letters  or  words  considered,  the  two  lists  have  the  same 
order — proverbs,  words,  syllables.  Thus,  from  the  data  of  this  ex- 
periment it  appears  that  among  materials  containing  letters  or  words, 
the  greatest  per  cent  of  false  recognition  is  found  in  that  material 
where  the  greatest  meaning  is  present  The  per  cent,  of  false  recog- 
nitions decreases  when  the  meaningful  associations  in  the  material 
decrease. 

The  range  of  the  per  cents  of  wrong  Nos  used  in  the  first  group 
is  from  22  per  cent  to  28  per  cent  and  in  the  second  group  from  21.5 
per  cent  to  37.5  per  cent  The  range  is  smaller  and  therefore  the 
difference  between  the  materials  is  less  for  wrong  Nos  than  for  wrong 
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TABLE  TTCT 

Recognition  Words 

Vint  8tt»  Vlrst  Series 

Vint  Bet*  Second  Series 

Yes 

No   

Old 
740 

254 

New 

78 
928 

Total 
818 
1,182 

%B4fbt 

90 
79 

Old 

752 

235 

New 

158 
839 

Total 
910 

1,074 

% 

Bight 
83 

78 

Total  

%  light  . . 

994 
75 

1,006 
92 

2,000 

987 
76 

997 
84 

1,984 

Second  Bet»  Vint  Dories 

Seeond  Bet  Seeond  Beries 

% 

Bight 

87 
87 

Yes 

No   

OM 
852.5 

242.5 

New 

112.5 
889.5 

Total 

765 

1,132 

%Ritbt 
87 
79 

m 

1 

New 
112 
882 

Total 
886 
1,008 

Total 

96  right  . . 

995 
76 

1,002 
89 

1,997 

L,000 
77 

89 

1,894 

vim 

Beoognition  Forms 

Sat 

Seeond  Set 

Yes 

No    

Old 

553.5 
428.5 

New 

280.5 

718.5 

Total 
844 
1,147 

%  Bight 
66 
63 

Old 
672 

327 

New 

162 

817 

Total 
834 

1,144 

% 

Bight 

86 
71 

Total  

%  right  . . 

992 
57 

999 
72 

1,991 

999 
67 

989 

83 

1,978 

Recognition  Provxrbs 

Vint  Set 

Seeond  Bet 

Yes 

No   

Old 
733.5 

208.5 

942 
78 

New 
65.5 

989.5 

1,055 
94 

Total 

799 

1,198 

1,997 

%  Bight 
97 

83 

Old 

736 
244 

New 

68 

945 

Total 
804 

1,189 

% 

Bight 

91 
79 

Total   

%  right  .. 

980 
75 

1,013 
93 

1,993 

Beoognition  Syllables 

vim  Bet 

Beoond  Bet 

% 

Bight 
64 

81 

Yes 

No    

Old 

558 

426 

New 

196 
818 

Total 

754 
1,244 

%  Bight 

74 
66 

Old 

534 
216 

New 
302 

939 

Total 

836 

1,155 

Total   

70  ngnt  . . 

984 
56 

1,014 
81 

1,998 

750 
71 

1,241 
76 

1,991 

3.  The  Comparison  of  the  Per  Cent,  of  Wrong  Yeses  Among  AU  Be* 
spouses  with  the  Per  Cent,  of  Wrong  Nos  to  AU  Responses 

Table  XXlX.  showB  the  per  cent  of  wrong  Ysses  among  all 
YEses  and  the  per  cent  of  wrong  Nos  among  all  Nos.  The  per  cent, 
of  wrong  YEseg  among  all  Ynses  varies  in  the  first  group  from  3  to  14 
per  cent  and  in  the  second  group  from  3.5  to  11  per  cent,   Fromtha 
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TABLE  XXXI 


Wrong    Wrong  Wrong      Wrong 

Hon         Wrong    Wrong         Ywb         No  Txms        Not 

Uied    Used         Ywmm      Noa       AH  Ymm  AH  Not       AH  Baao.  All  Beep.  % 

F. 430  588          37  107  9%  19%  4.0%  11.0% 

M. 435  564          75.5  125.5  17%  24%  8.0%  14.0%  82.0% 

F. 440  555  139.5  206.5  32%  37%  14.0%  21.0% 

H. 413  592  141  222  34%  38%  14.0%  22.0%  64.5% 

P. 424  575          34.5  131.5  8%  23%  3.0%  13.0% 

M. 375  623          31  149  8%  24%  3.0%  15.0%  83.0% 

P 389  609  105  193  27%  32%  11.0%  19.0% 

M. 365  635          91  233  25%  37%  9.0%  23.0%  69.0% 

P 405  595          18  113  4%  19%  1.8%  11.3% 

H. 413  587          60  141  17%  24%  6.0%  14.1%  68.0% 

P. 477  519          72         93  15%  18%  7.2%  9.3%  84.0% 

M. 433  555          86  143  20%  26%  8.6%  14.3%  76.0% 

P. 436  551          82  151  19%  27%  8.0%  15.0%  77.0% 

M 401  593          80  176  20%  30%  8.0%  17.6%  74.0% 

P. 414  583          43  110  10%  26%  4.0%  11.0%  85.0% 

M. 390  606          25  134  6%  22%  3.0%  13.0%  84.0% 

P. 435  557  115.5  135.5  27%  24%  12.0%  14.0%  74.0% 

M. 401  598  100.5  166.5  24%  28%  10.0%  17.0%  73.0% 

P. 445  453          48         98  11%  21%  4.8%  10.9%  84.3% 

M. 441  555          64  128  15%  23%  6.6%  12.9%  80.5% 

superior  to  the  men  in  the  recognition  of  old  items  as  old  and  of  new 
items  as  new.  By  calculating  the  average  per  cent,  of  the  wrong 
YEses  among  all  Yises  in  the  ten  tests  by  women  and  by  men  the 
scores  are  16.2  for  the  former  and  18.6  for  the  latter  or  a  difference 
of  2.4.  The  average  per  cent,  of  wrong  Nos  among  all  the  Nos  in  the 
ten  tests  by  women  and  by  men  are  24.6  for  former  and  27.6  for 
latter  or  a  difference  of  3.0. 

6.  Comparison  Between  Men  and  Women 

In  each  of  the  ten  tests  the  women  have  a  higher  per  cent,  of  cor- 
rect responses  than  the  men.  The  difference  between  the  sexes  varies 
from  1  per  cent,  to  6.4  per  cent  in  the  second  group  and  from  2  per 
cent,  to  7  per  cent,  in  the  first  group.  The  women  recognize  better 
than  the  men  do  as  it  has  been  seen  in  Chapter  V. 

7.  The  Comparison  of  Old  and  New  Judged  Correctly. 

How  many  old  are  judged  correctly  T  How  many  new  are  judged 
correctly  f  The  correct  response  to  the  Old  is  Yes  and  to  the  New  is 
No.  The  data  show  that  more  YEses  for  old  occur  than  Nos  for 
new— -that  is,  the  new  are  right  oftener  than  the  old.  The  new  make 
a  distinct  impression  and  the  subject  responds  with  more  certainty. 
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Among  the  old  ones  are  failures  of  recognition  but  among  the  new 
are  few  false  recognitions.  Nos  are  used  oftener  than  Ysses  and 
more  Nos  are  wrong.  When  Yes  is  used  the  subject  has  a  fairly  clear 
recognition.  The  Nos  include  errors  due  to  failure  to  recognize  but 
the  Ysses  do  not  include  many  new  not  recognized. 

Methology  of  Scoring 

In  scoring  for  recognition  the  score  of  the  positive  and  the  score 
of  the  negative  should  be  considered.  The  right  Ysses  minus  the 
wrong  Ysses  equals  the  score  of  the  positive ;  the  right  Nos  minus 
the  wrong  Nos  gives  the  score  of  the  negative.  The  sum  of  the  score 
of  the  positive  and  the  score  of  the  negative  equals  the  Recognition 
Score. 

"Negative"  Recognition 

In  positive  recognition  the  answer  Yes  is  given  to  an  item  which 
is  old.  We  recognize  it  as  something  familiar.  In  so-called  negative 
recognition  the  answer  is  No  to  an  item  which  seems  new.  There  is 
a  "newness  for  the  new"  which  leads  to  the  conclusion  that  the  item 
has  not  been  seen  before.  This  strangeness  or  newness  appears  to 
be  a  positive  thing.  "Negative"  recognition  is  not  always  the  mere 
casting  aside  of  something  which  lacks  familiarity  but  rather  some- 
thing which  possesses  a  "newness"  or  strangeness. 


CHAPTER  VHI 

Conclusions 

The  present  study  has  been  interested  in  the  two  methods  of  test- 
ing memory,  recall  and  recognition.  To  reproduce  or  recall  what 
one  has  seen  or  heard  is  different  from  recognizing  it  as  something 
previously  seen  or  heard  when  it  is  presented  again.  To  the  writer 
both  experiences  equally  seem  to  deserve  the  term  memory,  but  the 
terms  recall  or  reproduction  and  recognition  should  be  used  to  dis- 
tinguish them. 

The  results  of  the  foregoing  experiments  on  recall  and  recogni- 
tion may  be  summarized  as  follows: 

1.  More  items  are  recognized  than  recalled.  The  difference  in 
recall  and  recognition  memory  is  in  part  dependent  on  the  richness 
of  associations  present 

2.  Determined  recall  differs  from  undetermined  recall  more  than 
determined  recognition  differs  from  undetermined  recognition.  In 
the  tests  where  the  subjects  did  not  know  that  their  memory  would 
be  measured  the  records  are  for  undetermined  recall  and  undeter- 
mined recognition,  and  in  the  tests  where  the  subjects  were  aware 
that  their  memory  was  to  be  tested,  the  records  are  for  determined 
recall  and  determined  recognition.  The  difference  between  the  rec- 
ords when  the  subjects  knew  and  when  they  did  not  know  their 
memory  was  being  tested  is  greater  in  the  tests  for  recall  than  in  the 
tests  for  recognition. 

3.  The  difference  between  recall  and  recognition  is  greater  when 
the  subjects  did  not  know  that  their  memory  was  to  be  tested  than 
when  they  did  know. 

4.  The  influence  of  a  determining  factor  is  greater  for  the  recall 
of  material  rich  with  associations  than  for  material  devoid  of  them. 
The  advantage  of  making  the  observer  determine  to  remember  the 
material  presented  is  greater  when  the  material  is  meaningful  and 
rich  with  associations  than  when  it  is  nonsense.  There  is  more  differ- 
ence in  the  scores  for  photographs  than  for  nonsense  syllables. 

5.  The  determining  factor  influences  the  amount  of  the  material 
remembered  which  can  be  correctly  associated  with  other  material 
remembered.  The  subjects  could  name  the  photographs  better  when 
they  had  tried  to  remember  names  and  faces.  This  might  have  in- 
teresting applications  in  daily  life.    People  who  say  that  they  can 
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eight  and  eighteen  are  higher  than  those  for  the  girls  at  the  ages 
sixteen  and  seventeen  only. 

In  general,  there  is  no  marked  difference  in  achievement  between 
recall  and  recognition  for  the  sexes. 

14.  No  difference  in  variability  between  the  boys  and  girls  is 
apparent  when  the  Pearson  Coefficient  or  the  P.E.  are  used  as  the 
measures  of  variability.  The  coefficients  of  variability  for  adults  are 
slightly  higher  for  men  but  there  is  no  striking  sex  difference. 

15.  For  words,  forms,  and  syllables  for  both  recall  and  recogni- 
tion Hie  scores  are  higher  for  older  ages  than  for  younger  ones.  Both 
recall  and  recognition  seem  to  improve  with  age. 

16.  There  is  a  tendency  for  the  scores  to  improve  gradually  from 
4A  through  45  for  recall  and  for  recognition  of  words,  forms,  and 
syllables,  regardless  of  the  age  of  the  child. 

17.  The  oldest  children  in  a  grade,  on  the  average,  do  not  have 
the  best  scores,  but  they  do  not  always  have  the  worst  scores.  The 
children  at  the  median  age  for  their  grade  do  not  have  the  best  nor 
the  worst  scores.  There  is  a  tendency  for  the  scores  of  those  who 
are  younger  than  their  classmates  to  be  higher,  with  the  possible  ex- 
ception of  syllables. 

18.  Among  the  insane  patients  tested  there  is  no  evidence  of  the 
disease  influencing  recall  and  recognition  in  different  ways. 

19.  When  the  subject  is  asked  to  respond  Yes  to  items  which  he 
recognizes  as  seen  before  and  No  to  those  not  seen  before,  he  responds 
No  more  often  than  Yes.  The  difference  between  the  number  of 
Ysses  and  Nos  used  is  less  for  words  than  for  other  materials.  There 
is  no  consistency  between  the  two  sets  of  material,  however.  For 
example,  the  difference  between  Yeses  and  Nos  used  in  the  tests  for 
recognition  of  syllables  are  399  and  385  and  in  the  tests  for  recogni- 
tion of  syllables  are  490  and  299. 

20.  A  larger  number  of  Nos  are  wrong  than  Yisses.  From  the 
data  of  this  experiment  it  appears  that  among  materials  containing 
letters  or  words,  the  greatest  per  cent  of  false  recognitions  is  found 
in  that  material  where  the  greatest  meaning  is  present.  The  per  cent, 
of  false  recognitions  decreases  when  the  meaningful  associations  in 
the  material  decrease. 

In  each  of  the  ten  tests  the  per  cent  of  right  responses  among 
the  new  items  is  greater  than  among  the  old.  The  subjects  appear 
to  be  more  often  correct  in  judging  a  thing  as  not  seen  before  than 
as  seen  before. 

ZL  The  per  cent  of  wrong  Nos  among  all  the  responses  is  greater 
in  each  of  the  ten  cases  than  the  per  cent  of  wrong  Ysses.    Among 
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Better  late  than  never. 

Gifts  make  beggars  bold. 

Too  far  east  is  west 

No  news  is  good  news. 

Offenders  never  pardon. 

Hake  bay  while  the  son  shines. 

Look  before  70a  leap. 

The  carry  bird  catches  the  worm. 

Beggars  cannot  be  choosers 

Many  hands  make  light  work. 

Easy  come  easy  go. 

Guilt  is  always  jealous. 

A  bird  in  the  hand  is  worth  two  in  the  bush. 

Better  ask  than  go  astray. 

He  who  gives  quickly,  gives  doubly. 

No  road  ie  long  with  good  company. 

He  who  is  well  paid  is  well  satisfied. 

Yon  can  force  an  ox  to  water  bat  yon  can't  make  him  drink. 

It  never  rains  but  it  poors. 

A  burnt  child  dreads  the  fire. 

A  good  hope  is  better  than  a  bad  possession. 

Company  in  distress  makes  trouble  less. 

A  fall  cap  mast  be  carried  steadily. 

A  friend  in  need  is  a  friend  in  deed. 

Many  cooks  spoil  the  broth. 

Abundant  caution  does  no  harm. 

Practice  makes  perfect. 

Every  hill  has  a  valley. 

A  small  gift  is  better  than  a  great  promise. 

A  golden  bit  makes  none  the  better  home. 

A  thing  too  much  seen  is  little  prised. 

Necessity  is  the  mother  of  invention. 

One  good  turn  deserves  another. 

Dont  cross  the  bridge  until  you  come  to  it. 

A  fog  cannot  be  dispelled  by  a  fan. 

One  must  cut  his  coat  according  to  his  doth. 

AH  comes  right  to  him  who  can  wait. 

Those  who  ehmb  high  often  have  a  fall. 

An  empty  bag  cannot  stand  upright. 

Lasy  f  oiks  take  the  most  pains. 

A  little  spark  kindles  a  great  fire. 

A  handful  of  common  sense  is  worth  a  bushel  of  learning. 

Expect  not  at  another's  hand  what  you  can  do  by  your  own. 

Spin  not  too  fine  a  thread  lest  it  break  in  weaving  it. 

People  who  Eve  in  glass  houses  should  not  throw  stones. 

Opportunity  knocks  but  once,  for  the  world  hates  a  knocker. 

Birds  of  a  feather  flock  together. 

A  penny  saved  is  a  penny  gained. 

Better  cut  the  shoe  than  pinch  the  foot. 

'Where  everyone  goes  the  grass  never  grows. 

There  is  no  bush  so  small  but  easts  its  shadow. 
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You  can't  have  the  cake  end  eat  it  too. 

Prevention  is  better  than  core. 

Faint  heart  never  won  fair  lady. 

A  willing  helper  does  not  wait  until  ha  is  asked. 

Better  twice  measured  than  once  wrong. 

Hie  boughs  that  bear  most  hang  lowest. 

The  proof  of  the  pudding  is  the  eating. 

Practice  what  yon  preach. 

Imitation  is  the  sincerest  flattery. 

Good  coral  needs  no  coloring. 

A  rolling  stone  gathers  no  moss. 

Where  there's  lire  there's  smoke. 

The  better  the  day  the  better  the  deed. 
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THE  MORPHOLOGIC  ASPECT  OF  INTELLIGENCE 

The  problem  of  the  correlation  between  bodily  and  mental  traits 
has  attracted  the  attention  of  educators,  psychologists,  physicians 
and  sociologists  during  the  last  few  decades. 

For  a  great  many  years  the  problem  has  been  laid  merely  on 
hypothesis  and  studied  empirically ;  but  only  in  recent  years,  namely 
after  the  introduction  of  the  mental  tests,  has  it  been  possible 
to  approach  the  same  with  rational  methods  and  to  put  it  on  a 
scientific  basis. 

In  the  matter  of  correlation  with  intelligence  it  must  be  admitted 

however  that,  while  in  the  study  of  the  tests  for  physical  and  motor 

capacity,   different   investigators   have   reported   satisfactory  and 

usually  rather  concordant   results,   the   so-called   anthropometric 

tests  are  still  the  subject  of  discrepancies  and  controversies. 

Of  course  today  we  possess  better  scales  for  measuring  intelligence ; 
but  the  use  of  less  accurate  scales  for  intelligence  on  which  former 
investigators  had  to  rely  alone  does  not  justify  the  contrasting  results 
obtained  in  the  study  of  Correlation  between  intelligence  and 
anthropometric  traits,  such  as  height,  weight,  skull  diameter, 
cephalic  index,  etc. 

If  we  take  height  for  instance,  we  find  that  Kline  l  reports 
that  boys  in  public  schools  are  taller  than  boys  in  truant  schools. 
Smedley 2  reports  that  boys  in  the  schools  for  incorrigibles  and 
truants  are  shorter  than  normal  boys,  and  that  bright  children  are 
taller  than  dull  children.  These  conclusions  of  Smedley's  agree 
with  those  of  Sack,8  Gratianoff,4  Porter,5  Mac  Donald,6  De  Busk  7 
and  others ;  while  West 8  found  the  opposite  to  be  true  and  Gilbert 9 
failed  to  find  any  definite  correlation  between  height  and  mental 
ability. 

Again  if  we  take  weight,  we  find  that  Porter,5  Smedley2  and 
De  Busk  7  reported  that  bright  children  are  heavier  than  dull 
children  of  the  same  age;  while  for  West 8  and  Gilbert 9  the  reverse 
is  true. 

The  same  conflicting  reports  were  given  by  investigators  who 
studied  cephalic  index,  lung  capacity,  facial  measurements,  color 
of  eyes,  etc. 

No  wonder  the  results  are  so  diverse.  A  single  anthropometric 
measurement  cannot  constitute  the  characteristic  of  such  a  complex 
mental  trait  as  intelligence,  to  which  so  many  factors  contribute. 
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2.  Length  of  sternum:  (A  B) — from  the  jugular  incisure  to  the 
point  of  insertion  of  the  ensiform  appendix. 

3.  Length  xipho-epigastric:  (B  C) — from  the  point  of  insertion 
of  the  xiphoid  appendix  to  the  epigastric  point.  This  point  (C)  is  at 
the  crossing  of  the  middle  vertical  line  of  the  trunk  with  the  hori- 
zontal line  passing  through  the  lower  margin  of  the  tenth  rib  (Z  W). 

4.  Length  epigastric-pubic:  (C  D) — from  the  epigastric  point  to 
the  upper  margin  of  the  pubis. 

5.  Length  of  the  lower  extremities:  (V  T) — from  the  upper  margin 
of  the  pubic  bone  to  the  external  malleous  of  the  foot. 

6.  Length  of  the  upper  extremities:  (R  S) — from  the  margin  of 
the  acromion  process  to  the  wrist-joint  while  the  arms  hang  down ; 
(I  have  preferred  the  stiloid  process  of  the  radius  as  point  of 
repere). 

7.  Transverse  thoracic  diameter  or  breadth  diameter  taken  at 
the  level  of  the  4th  rib  (E  F). 

8.  Antero-posterior  thoracic  diameter  or  depth  diameter  taken  also 
at  the  level  of  the  4th  rib  (M  N). 

<>.  Transverse  epigastric  diameter  taken  at  the  mid-point  of  the 
xipho-epigastric  line  (G  H). 

10.  Antero-posterior  epigastric  diameter  taken  as  the  same  level 
of  the  preceding  diameter  (P  Q). 

11.  Transverse  pelvic  diameter  taken  between  the  iliac  crestae 
at:  the  point  of  the  maximum  breadth  (I  L). 

(For  the  explanation  of  letters  in  parentheses  see  figure  1  and  the 
annexed  anthropometric  blank.) 

Viola    has    devised    special    instruments    for    the    morphologic 

rneasurements,  but  one  who  is  familiar  with  anthropometry  can 

obtain  practically  the  same  results  with  a  little  more  time  and 

Patience,  by  using  an  anthropometric  tape,  a  chest  depth  caliper,  a 

chest  breadth  caliper  and  a  height  stand. 

For  the  treatment  of  the  anthropometric  data  Viola  proceeds  in 
the  following  way: 

He  obtains  a  thoracic  index  or  a  thoracic  value  by  multiplying  the 
length  of  the  sternum  by  the  transverse  thdracic  diameter  and  by 
the  antero-posterior  thoracic  diameter  (AB  X  EF  X  MN).  By 
multiplying  the  length  xipho-epigastric  by  the  transverse  epigastric 
diameter  and  by  the  antero-posterior  epigastric  diameter  he  obtains 
the  index  of  the  upper  abdomen  (BC  X  GH  X  PQ).  The  index  of 
the  lower  abdomen  is  obtained  by  multiplying  the  length  pubo-epigas- 
tric  by  the  transverse  pelvic  diameter  and  by  the  antero-posterior 
epigastric  diameter  (CD  X  IL  X  PQ),  (the  antero-posterior  pelvic 
diameter  is  not  taken). 
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Sum  of  the  indices  of  the  upper  and  lower  abdomen  gives  the 
total  abdominal  value. 

Sum  of  the  thoracic  value  with  the  total  abdominal  value  gives 
the  value  of  the  trunk. 

The  value  of  the  limbs  is  obtained  by  adding  the  length  of  one 
of  the  upper  limbs  with  that  of  one  lower  limb  (RS+TV). 


Showing  how  measurements  are  taken.   For  the  expla- 
nation of  the  symbols  see  below. 


ANTHROPOMETRIC  BLANK 


-No Name Age  . 

Address 

1.  Length  of  sternum AB   . 

2.  Xipho-epigastric  line BC   . 

3.  Pu bo-epigastric  line CD   . 

4.  Transverse  thoracic  diameter EF    . 

5.  Antero-posterior  thoracic  diameter    ....   MN  . 

6.  Transverse  epigastric  diameter        GH  . 

7.  Antero-posterior  epigastric  diameter      .    .    .   PQ    . 

8.  Transverse  pelvic  diameter IL 

9.  Length  of  upper  extremity RS    . 

10.  Length  of  lower  extremity TV   . 

11.  Height 

12.  Weight 
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of  study  for  several  other  groups,  whose  morphologic  measurements 
could  not  be  taken,  without  pretending  that  the  ratio  of  height  to 
weight  may  substitute  the  morphologic  index  all  the  time  when 
correlating  mental  traits. 

The  advantages  of  using  the  morphologic  index  or  the  ratio  of 
height  to  weight  over  either  height  or  weight  alone,  in  the  correlation 
with  mental  traits,  are  obvious. 

One  does  not  need  to  be  tall  in  order  to  be  microsplanchnic  nor 

does  the  macrosplanchnic  need  to  be  short.    In  my  groups  one  can 

find  short  subjects  among  the  microsplanchnics  and  tall  subjects 

among  the  macrosplanchnics.    Microsplanchnics,  macrosplanchnics 

and  normosplanchnics  are  found  almost  in  the  same  proportions  in 

all  the  ethnic  groups,  and  one  does  not  need  to  look  into  remote 

ancestry  of  the  individuals  in  a  cosmopolitan  community.    Without 

denying  that  an  ethnic  group  may  give  more  individuals  of  a  definite 

morphologic  type  in  the  same  way  as  it  may  give  more  intelligent 

or  less  intelligent  types,  it  must  be  admitted  though  that  such 

influence  of  a  predominant  morphologic  type  in  a  stock  is  never  so 

great  as  stature.    Predominancy  of  a  given  type  is  undoubtedly  well 

pronounced  in  the  three  different  human  races,  white,  yellow  and 

black.     In  this  respect  Stratz's  w  distinction  of  the  human  types 

in    (A)  Leukederm  (white   races)    in    which   limbs   and   trunk   are 

proportionately    developed,    (B)  Melanoderm     (Negro    races)    in 

which  exists  an  excess  of  the  limbs  over  the  trunk,    (C)  Xantoderm 

(yellow  races)  in  which  exists  an  excess  of  the  trunk  over  the  limbs, 

has  to  be  kept  in  mind  when  studying  groups  of  subjects,  in  order 

that  the  groups  may  be  kept  homegeneous. 

Ranke  1S  divided  the  human  races  into  races  of  culture  and  races 
of  nature  including  in  the  first  group  the  white  and  the  yellows  who 
tend  to  brachyskely  (short  limbs)  and  in  the  second  group  the 
negroes  who  tend  to  dolichoskely  (long  limbs).  Of  course  in  the 
mind  of  the  German  anthropologist  no  hint  existed  as  to  the  con- 
ception of  hyperevolution  and  hypoevolution  of  the  individuals 
brought  forward  in  the  differentiation  of  the  two  opposite  types  the 
microsplanchnic  and  the  macrosplanchnic.  His  study  was  racial  and 
his  distinction  after  all  was  theoretical,  because  there  are  people  of 
culture  showing  both  dolichoskely  and  brachyskely,  as  e.g.  Mediter- 
ranean and  Baltic  races  respectively  brachyskele  and  dolichoskele, 
and  people  of  nature  such  as  Bushmen  and  Australians  respectively 
brachyskele  and  dolichoskele.  From  the  individual  point  of  view  we 
consider  the  dolichoskele  type  of  culture  and  the  brachyskele  type 
of  nature,  whether  macrosomatic  or  microsomatic. 
Recent  attempts  are  being  made  to  correlate  facial  measurements 


Morphologic  Index  as  an  Indicator  of  Intelligence  n 

One  may  observe  that  muscles  and  bones  constitute  the  greater 
part  of  the  weight  of  the  body,  whereas  the  viscera    represent  a 
small  fraction.     Judging  from  this  point  of  view  weight  should  con- 
stitute a  positive  and  not  a  negative  factor  as  it  appears  from  the 
correlation  between  ratio  height  to  weight  and  intelligence.     While 
this  cannot  be  denied,  it  must  be  admitted  though  that  in  true 
raacrosplanchnic  types  the  weight  of  the  viscera,  fat  and  cutaneous 
annexes,  which  in  normosplanchnic  individuals  represent    about 
40%  of  the  body  weight,  go  beyond  the  40%  at  the  expenses  of  the 
systems  of  the  animal  life.    In  some  individuals  having  tendency  to 
obesity  the  muscular  fibers  are  usually  infiltrated  with  adipose 
tissue;  therefore  even  a  method  which  could  give  the  absolute  weight 
ot  the  striated  muscles,  such  as  the  volumetric  estimation  of  a  limb 
by  displacement  of  fluid,  would  not  be  free  from  error  because  it 
would  not  take  into  account  the  quality  of  the  muscular  system. 

But  there  is  another  element  to  be  considered  in  the  larger 

volumetric  or  ponderal  mass  of  the  muscles  of  the  macrosplanch- 

nio    The  macrosplanchnics,  having  short  limbs,  have  also  short 

muscles  and  smaller  portion  of  attachment  on  the  bones:     this, 

Viola  points  out,  means  that  the  muscular  system  was  primarily 

deficient   and   only  secondarily   became  excessive,  owing   to   the 

*  increase  in  size  and  number  of  muscular  fibers  due  to  the  excessive 

nutritional  activity  of  the  organism.    Besides  a  short  large  muscle 

*xxay  have  advantage  over  a  long  thin  muscle  in  what  concerns 

Amount  or  quantity  of  energy,  not  in  what  concerns  quality  of 

^xrhievement;  a  thin  long  muscle  may  give  poorer  but  more  highly 

Specialized  movements. 

The  substitution  of  the  ratio  of  height  to  weight  for  the  morpho- 
logic index  practically  eliminates  the  error  due  to  muscle  influence, 
in  as  much  as  the  muscles  of  the  limbs  are  neither  added  nor  sub- 
tracted in  our  calculation.  For  this  reason  probably  the  correla- 
tion morphologic  index-intelligence  was  found  larger  than  the 
correlation  ratio  height  to  weight-intelligence.  At  any  rate  even 
the  morphologic  index  is  not  free  from  errors  of  computation. 

Since  an  ideal  method  which  could  give  the  exact  value  of  both 
the  animal  and  the  vegetative  systems,  taking  into  account  quantity 
and  quality,  in  living  subjects  is  not  possible,  we  have  to  be  satisfied 
with  methods  which  give  us  approximate  values. 

Regarding  the  second  fact,  here  is  the  summary  of  the  proofs 
brought  by  Viola  to  demonstrate  that  the  microsplanchnic  is  a 
hyperevolute  type  and  the  macrosplanchnic  is  hypoevolute  from 
the  point  of  view  of  physical  development. 

All  the  characteristics  which  differentiate  the  newborn  from  the 
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though  we  are  still  unable  to  discover  how  and  where  this  em- 
ployment takes  place.     If  such  enormous  dispersion  is  necessary  for 
biological  potential  activities  yet  unknown  to  us,  we  may  suppose 
that  microsplanchnics  must  gain  some  sort  of  compensatory  advan- 
tages for  their  larger  dispersion  of  heat. 

External  stimuli,  which  have  so  much  influence  on  our  nervous 
system  and,  therefore,  on  our  mood  and  behavior  must  necessarily 
act  in  a  different  way  on  the  relatively  larger  receptive  surface  of 
the  microsplanchnic  and  on  the  relatively  small  cutaneous  surface 
of  the  macrosplanchnic.  Take  for  instance  such  cosmic  stimuli  as 
sun  heat,  sun  light,  barometric  pressure,  etc.,  we  all  know  how  much 
influence  they  have  on  our  mood  and  consequently  on  our  behavior. 
We  usually  give  importance  to  the  atmospheric  conditions  in  a 
general  sense,  but  we  never  take  into  consideration  the  important 
element  of  our  somatic  individuality.  Now  the  macrosplanchnics 
having  a  relatively  reduced  receptive  surface  for  the  external  stimuli 
must  have  retarded  nervous  reactions,  comparatively  little  sensitive 
life,  lessened  psychic  functions:  whereas  the  opposite  must  be  true 
of  the  microsplanchnics  who  will  be  quicker  but  more  exhaustible 
in  their  nervous  reactions,  and  will  possess  a  greater  degree  of  sen- 
sitiveness to  pain,  thermal  and  electric  stimuli. 

Regarding  the  third    fact,  it   is   nowadays  accepted  by  endo- 
crinologists that  in  physiological  hyperthyroidism  the  organism  tends 
t.o  grow  more  along  the  vertical  diameters,  namely  it  tends  to  grow 
irt  length  rather  than  in  width.    Thyroid  hormones  have  some  rela- 
tionship with  intelligence.     Witness  cretinism  and  the  manifold 
indications  which  come  to  us  from  clinical  cases.    Schlesinger  (13) 
has  recently  reported  that  in  a  region  where  goiter  is  endemic,  the 
growth  and  development  of  the  children  with  this  hy  per  thyroid  isir 
are  usually  in  advance  of  their  years,  bo.th  physically  and  mentally. 
Now  a  few  points  must  be  made  clear  before  concluding. 
I  do  not  say  that  intelligence  can  be  measured  with  ratio  of  length 
of  limbs  to  volume  of  the  trunk,  or  with  ratio  of  height  to  weight  in 
the  sense  that  the  higher  the  morphologic  index  is,  the  more  intelli- 
gent is  the  subject  and  vice  versa.    Probably  the  best  intelligence  is 
not  found  among  the  highest  microsplanchnics,  as  these  are  likely 
to  be  borderline  pathologic  cases.   I  simply  say  that  generally  speak- 
ing individuals  showing  a  microsplanchnic  type  in  a  given  group  have 
more  likelihood  to  be  intelligent,  than  those  who  have  a  macrosplanch- 
nic tendency.    Normosplanchnics  show  all  degrees  of  intelligence. 
Usually  they  tend   to  normality  also  in   the  intellectual  domain. 
If  we  wanted  to  calculate  the  degree  of  intelligence  by  the  degree  of 
microsplanchny,  we  would  err,  in  as  much  as  the  ultramicrosplanch- 
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even  microsplanchnic.  This  fact  must  be  kept  in  mind  when  taking 
morphologic  indices  for  correlation  with  intelligence. 

When  I  say  that  measurements  should  be  taken  between  the  ages 
of  20  and  25,  I  do  not  deny  that  the  same,  if  taken  in  children  and 
in  adolescents  and  in  older  individuals  may  give  good  results. 
Children  and  youths  may  be  suitable  subjects  for  morphological 
experiments  provided  they  be  grouped  according  to  their  respective 
physiological  ages.  This  fact  is  important  because,  as  it  is  known 
from  physiology,  at  about  the  seventh  year  of  age  and  at  the 
puberal  period  the  organism  shows  a  rapid  growth  in  length  and 
therefore  it  tends  toward  microsplanchny:  whereas  during  infancy, 
after  the  25th  year  of  age,  and  a  few  years  before  pubescence  it 
shows  a  definite  tendency  toward  macrosplanchny.  Thus  in  each 
normal  individual  the  highest  degree  of  microsplanchny  is  attained 
at  puberty,  while  the  highest  degree  of  macrosplanchny  exists  at 
birth. 

According  to  Pende  (15),  during  the  periods  of  greater  growth  in 
height,  a  physiologic  hyperactivity  of  the  hormones,  which  pro- 
mote the  development  of  the  animal  system,  exists,  i.e.  some  hor- 
mones of  the  thyroid,  of  the  hypophysis,  of  the  cromaffin  tissue,  of 
the  endocrine  tissue  of  the  sex  glands.  These  hormones  promote 
and  stimulate  also  the  neuropsychic  activity,  and  possess  a  certain 
degree  of  inhibition  over  the  hormones  which  favor  the  nutri- 
tional or  vegetative  system. 

I  feel  justified  in  making  the  foregoing  statements,  because  I 
believe  that  some  of  the  hormones,  chiefly  thyroid  hormones,  which 
during  the  period  of  growth  regulate  the  morphology  of  the  body, 
influence  also  the  development  of  the  mentality.  Mind  in  the  same 
way  as  the  body  is  shaped  before  the  subject  has  attained  his  full 
stature,  ard  we  may  have  some  idea  of  the  hormonic  actions  exerted 
upon  the  mind,  looking  through  the  morphologic  type. 

Summing  up,  in  saying  that  the  microsplanchnic  type  is  the  intelli- 
gent individual,  I  do  not  extend  the  assumption  to  pathological 
cases,  nor  do  I  affirm  that  the  macrosplanchnic  type  cannot  be 
intelligent.  This  statement  must  be  made  clear  in  order  to  avoid 
erroneous  interpretations  of  my  theory,  which  are  likely  to  follow 
in  the  form  of  criticism,  as  was  true  in  the  case  of  Lombroso's 
theory  on  the  somatic  features  of  the  criminal,  so  that  every  mark 
of  degeneracy  was  taken  to  mean  an  indication  of  criminality  or 
degeneration,  an  assertion  which  Lombroso  never  made. 
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warm,  with  tendency  to  show  rapid  vasomotor  and  secretory  changes; 
digestion  and  assimilation  irregular  and  defective,  a  condition  which 
renders  the  hyperthyroids  very  cautious  in  the  selection  and  use  of 
food;    circulatory  system  shows  tendency  to  an  inverted  oculo- 
cardiac reflex  (negative  reflex  index)  (16),  to  tachicardia  and  to 
arterial  hypertension,  although  pulse  and  blood  pressure  show  large 
fluctuations  during  the  same  day;  baldness  and  gray  hair  rare  or 
latt:e  to  appear. 

Similarly  as  macrosplanchnics  show  somatic  resemblance  to  in- 
fants, that  is  they  keep  the  somatic  characteristics  of  infants,  the  hy- 
perthyroids (microsplanchnics)  tend  to  preserve  the  somatic  features 
of  youth.  For  this  reason  the  adult  hyperthyroid  looks  younger 
and  maintains  a  youthful  complexion  even  in  mature  age.  This  is 
due  to  the  fact  that  in  hyperthyroids  the  hyperactivity  of  the 
hormones  which  promote  the  development  of  the  animal  system 
and  which  are  very  active  throughout  the  period  of  growth  in 
length,  predominates  even  after  the  end  of  said  period:  while  in 
the  macrosplanchnics,  the  antagonistic  group  of  hormones,  which 
promote  the  development  of  the  visceral  system,  instead  of  giving 
way  to  the  other  group  of  hormones  at  the  proper  time,  has  per- 
sisted in  its  physiologic  hyperactivity  thus  giving  the  macro- 
splanchnic  the  infantile  trend  of  the  body. 

Not  less  striking  are  the  psychic  characteristics  of  the  hyper- 
thyroids.    As  Viola  observes,  the  microsplanchnic,  owing  to  the 
possession  of  a  minimal  organic  mass  and  a  maximal  surface  area 
of  the  body,  is  by  nature  endowed  with  a  strong  catalytic  stimula- 
tion and  with  an  eretistic  nervous  system.     His  large  receptive 
surface  area  renders  him  excitable,  and  any  form  of  external  influ- 
ence affects  his  type  more  than  any  other.     On  account  of  their 
limited  muscular  expansion,  the  hyperthyroids  do  not  indulge  in 
athletic  exercises  and  take  little  interest  in  the  practical  side  of  life 
but  conversely  acquire  a  great  transport  for  its  aesthetic  side. 
Therefore  the  hyperthyroids  love  indoor  games,  music,   poetry, 
arts  in  general,  theatre,  readings  and  works  of  the  nature  of  scien- 
tific research.     Also  their  minds  not  unlike  their  bodies  tend  to 
preserve  the  characteristics  of  youth,  so  they  are  rather  prone  to 
day  dreaming  and  to  being  absent-minded.    Being  intelligent  they 
possess  live  ideation,  prompt  perception,  vast  imagination,  strong 
memory,  and  shrewd  critique;  but  lack  of  concentration  and  un- 
steady will  power  may  hinder  their  learning  capacity.    Coenaesthetic 
variations  are  at  the  bottom  of  their  exaggerated  emotional  display 
and  of  their  rapid  changes  in  mood  which  they  often  show.    Most 
of  the   manic-depressive  characteristics   are   found   amongst   the 


SURVEY  OF  EXPERIMENTAL  WORK 

This  research  work  has  been  carried  out  on  College  and  Univer- 
sity students  of  the  white  race.  The  tests  used  correspond  to  the 
best  hitherto  devised  for  measuring  intelligence,  namely  the  "Alpha 
Army  Test,"  the  "Otis  Intelligence  Test,"  and  "Thorndike  Intelli- 
gence Examination  Tests."  The  above  mentioned  tests,  especially 
the  ones  devised  by  Thorndike,  greatly  reduce  the  chances  of  error 
in  what  concerns  the  measurement  of  one  of  the  traits  which  I  have 
correlated;  i.e.,  intelligence. 

I  omit  the  full  description  of  these  tests,  as  they  can  be  easily 
obtained  from  the  authors  or  publishers. 

Tests  embodying  the  principles  of  the  "Alpha"  and  "Otis"  scales 
were  used  on  more  than  a  million  and  a  half  men  upon  their  entry 
into  the  United  States  army.  They  are  designed  to  test  general 
mental  ability  and  are  suitable  for  all  literate  persons.  The  scales 
of  both  Alpha  and  Otis  tests  consist  of  8  to  10  tests  respectively, 
each  test  consisting  of  a  series  of  questions  or  problems.  There  are 
several  forms  of  the  Alpha  test,  and  two  forms  of  the  Otis  test, 
A  and  B;  these  forms,  while  different  in  substance  are  similar  in 
structure;  and  the  Total  Point  Scores  of  one  Alpha  Test  form  are 
equivalent  to  those  of  the  other  Alpha  forms;  likewise,  the  Total 
Point  Scores  of  one  Otis  form  are  equivalent  to  those  of  the  other 
Otis  form.  The  purpose  in  constructing  independent  scales  is  to 
provide  for  reexamination  after  a  short  interval  without  the  scores 
being  influenced  by  memory  of  previous  questions,  and  to  prevent 
collusion  between  groups  successively  examined. 

Without  entering  into  the  details  of  the  scoring  of  the  Alpha  and 
the  Otis  tests,  I  simply  mention  that  scores  range  from  o  to  212  for 
"Alpha"  and  from  o  to  230  for  "Otis."  In  our  groups  scores  ranged 
from  76  to  176  and  from  121  to  220  respectively. 

The  Thorndike  Intelligence  Examination  Tests  were  devised  by 
Prof.  Thorndike  with  the  purpose  of  supplanting  the  old-fashioned 
examinations  for  students  entering  colleges,  schools  of  engineering 
and  Professional  Schools.  The  good  results  obtained  during  the 
first  two  years  these  intelligence  examinations  were  administered 
authorize  us  to  consider  their  scores  the  best  indicators  of  intelligence 
at  the  present  time. 

Here  are  a  few  points  I  take  from  the  Standard  Instructions: 

The  examination  is  composed  of  three  parts.     Part  I  comprises 
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of  117  to  a  maximum  of  54.  Their  ages  vary  from  17  to  22  years. 
Some  were  younger  when  they  took  the  examination. 

Aside  from  these  college  boys  who  constitute  the  greater  number 
of  my  subjects,  I  have  examined  two  other  groups  of  50  and  94 
Summer  Session  students  of  both  sexes,  whose  ages  in  many  cases 
were  above  25  years. 

Except  for  the  last  two  groups  the  anthropometric  measurements 
were  taken  at  the  gymnasium  in  metric  system  units. 

Regarding  the  reliability  of  the  physical  measurements  a  few 
points  need  to  be  explained. 

Weight  and  height  do  not  require  any  particular  skill,  with  a  good 
scale  and  a  reliable  stadiometer  any  intelligent  examiner  can  claim 
to  be  accurate. 

Some  anatomical  knowledge  and  anthropometric  training  is 
required  before  one  can  advance  any  claim  to  accuracy  in  the  anthro- 
pometric measurements. 

The  anatomical  points  must  be  first  established  on  the  subject; 
it  is  better  to  mark  them  down  with  a  dermographic  pencil.  The 
vertical  measurements  are  taken  between  the  marked  points  with 
an  anthropometric  tape.  For  the  transverse  and  antero-posterior 
diameters  of  the  trunk  the  Seaver  Rod  Caliper,  which  can  be  used 
for  breadth  as  well  as  for  depth  measurements  has  served  my  pur- 
pose most  satisfactorily. 

Control  measurements  are  advisable,  as  for  instance  in  the  case 
of  the  three  first  measurements  Sternum,  Xipho-epigastric  line  and 
Pubo-epigastric  line,  one  should  ascertain  himself  that  the  whole 
length  Sternum-Pubis  corresponds  to  the  sum  of  the  three  different 
segments. 

Measurements  should  be  extended  to  millimeters.  An  error  of  1 
mm.  will  reduce  or  increase  the  index  to  about  10  counts.  An  error 
of  }4  cm.  plus  or  minus  would  cause  a  change  of  50  counts  in  the 
index.  This  probable  error  in  excess  or  in  defect  in  all  the  measure- 
ments is  of  course  rare,  error  usually  occurring  in  one  or  two  measure- 
ments with  the  probability  of  being  compensated  by  errors  in  defects 
or  if  not  compensated  at  all,  with  the  modification  of  a  few  counts 
on  the  morphologic  index.  At  any  rate  such  errors  will  have  no 
substantial  influence  on  the  correlation  and  in  no  instance  will  they 
effect  the  transformation  of  a  microsplanchnic  into  a  macrosplach- 
nic  and  vice  versa. 

In  the  group  of  75,  the  morphologic  index  ranges  from  435  to  721. 
Now  by  disregarding  the  third  digit  the  indices  are  computed  from 
43  to  72  making  30  steps,  the  correlation  will  persist. 

In  the  group  of  50  the  morphologic  index  ranges  from  360  to  671. 
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research,  being  usually  intelligent  individuals  who  had  resisted  the 
practical  elimination  tests  of  school,  offer  small  intelligence  differ- 
ences. If  the  same  research  is  carried  out  on  groups  of  individuals 
who  did  not  receive  high  school  education,  the  larger  intelligence 
ranges  which  will  be  found  will  probably  cause  the  correlation  to  be 
higher. 

In  none  of  the  groups  studied  by  me  was  any  correlation  found 
between  height  and  intelligence,  nor  between  lung  capacity  and 
intelligence,  the  latter  being  —  .10  in  136  subjects. 

Weight  and  volume  of  trunk  yielded  negative  correlations  with 
intelligence. 

My  correlation  reviewed  by  a  statistician  (Wood)  with  different  methods  gave  the 
following  coefficients: 

r  221  subjects.  Intelligence  — height  +.0415 

"  221        "  "         —weight  -.183 

221        "  "         — ratio  H:W  +.230 

75        "  "         — length  of  limbs         +.155 

75        "  "         — volume  of  trunk      —.360 

75        "  "         — morphologic  index  +.356 

136       "  "         — lung  capacity  —.105 


•« 
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period,  environment,  diseases,  traumata  (physical  and  moral) 
improper  diet,  etc.,  may  affect  the  function  of  one  or  more 
endocrine  glands,  and  thus  produce  morphologic  deviations 
which  are  usually  accompanied  by  mental  deficiencies  or  gains 
on  account  of  interrelations  existing  between  the  morphoregula- 
tor  and  the  neuroregulator  hormones. 

After  the  age  of  25  external  factors  such  as  marriage,  occupa- 
tion, diet,  climate,  etc.,  may  cause  changes  in  the  organism 
by  which  the  morphologic  type  may  be  more  or  less  modified 
from  what  it  primarily  was.  Therefore  morphologic  index 
and  ratio  height  to  weight  taken  in  adults  should  be  referred 
to  the  age  of  25. 

7.  Owing  to  racial  tendency  toward  brachiskely  and  dolichos- 
kely,  one  should  avoid  putting  together  in  the  same  group, 
when  taking  the  morphologic  index,  individuals  of  different 
races  (namely  the  white,  the  yellow  and  the  negroid). 

8.  My  experimental  study  has  shown  that  a  positive  correlation 
exists  between  intelligence  and  the  ratio  of  height  to  weight. 
The  average  coefficient  of  correlation  found  in  the  group  of 
221  students  was  equal  to  +  .228  with  a  P.E.  equal  to  .044. 

9.  The  ratio  of  height  to  weight  gives  an  approximate  indication 
of  the  morphologic  type  of  the  individual,  since  there  is  a 
correlation  of  about  +  .7  or  more  between  that  ratio  and  the 
morphologic  index,  as  shown  by  the  analysis  of  125  students, 
whose  anthropometric  measurements  were  taken. 

Individuals  showing  a  high  morphologic  index  and  a  high  ratio 
of  height  to  weight  correspond  to  the  microsplanchnics;  the 
lower  indices  and  lower  ratios  correspond  to  the  macro- 
splanchnics. 

10.  A  higher  positive  correlation  is  found  when  instead  of  the  ratio 
of  height  to  weight,  the  morphologic  index  is  taken  as  the 
expression  of  the  type  of  the  subjects.  The  morphologic  index 
is  found  by  dividing  the  length  value  of  the  two  limbs  by  the 
volumetric  value  of  the  trunk. 

A  group  of  75  male  students  which  gave  a  correlation  of  +.16 
with  the  ratio  of  height  to  weight  gave  a  coefficient  of  +.35 
and  a  P.E.  equal  to  .068,  with  the  morphologic  index. 

11.  No  correlation  was  found  in  any  one  of  the  groups  examined 
between  height  and  intelligence.  Similarly  no  correlation 
was  found  to  exist  between  lung  capacity  and  intelligence  in 
136  of  the  students  making  the  group  of  221,  whose  lung 
capacity  had  been  measured.  Weight  gave  a  negative  correla- 
tion. 
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TABLE  I 

Ratio 

Int. 

No.                           Height 

Weight 

H:W 

Score 

I                               ] 

171 

593 

2.883 

"7 

2 

165 

64.5 

2.558 

114 

3 

154 

47.6 

3235 

107 

4 

[66 

62.1 

2673 

107 

5 

[66 

54 

3-074 

104 

6 

[66 

56.2 

2954 

104 

7                         ] 

165 

53.1 

3107 

103 

8 

1845 

54.2 

3404 

101 

9                          J 

[67.6 

61.2 

2.739 

101 

IO                                 ] 

174.4 

647 

2.695 

100 

ii                         i 

166.5 

55 

3027 

100 

12                                 ] 

[70 

62.3 

2.729 

100 

13 

165.5 

-60.1 

2.754 

99 

14                         ] 

173 

•  62.5 

2.768 

98 

15                         1 

[62.8 

56.4 

2.887 

98 

16                         ] 

[64 

48.1 

3-4" 

97 

17                          1 

[67 

78.6 

2,125 

94 

18                          ] 

177.1       . 

55.8 

3.174 

93 

19                         i 

175 

52.7 

3320 

93 

20                                 ] 

[62.5 

70.1 

2.318 

92 

21                                   ] 

[78 

57.2 

3-1 12 

91 

22                                   ] 

165.4 

51.1 

3236 

91 

23                                   1 

[68.4 

593 

2.840 

00 

24                             ] 

171 

594 

2.879 

90 

25                          J 

1551 

43.1 

3-598 

89 

26                                 ] 

171 

60.8 

2.812 

89 

27                            ] 

1495 

535 

2.794 

88 

28                                  ] 

[80.1 

84.8 

2.124 

88 

29                             1 

[68 

65 

2.584 

88 

30                         i 

[66.5 

65 

2.562 

88 

31                          i 

[67 

53 

3-I5I 

87 

32                          3 

170.4 

58.1 

2.933 

87 

33                          i 

165 

542 

3044 

86 

34                          ^ 

175.5 

58.9 

2.980 

86 

35                          J 

[81.6 

60.7 

2.992 

86 

36                          ] 

177 

553 

3201 

86 

37                          3 

175 

65 

2.692 

86 

38                          ] 

167 

58 

2.879 

86 

39                         i 

[70.5 

58 

2.940 

85 

40                         ] 

178 

634 

2.808 

85 

41                          ] 

[76.1 

59-6 

2.955 

85 

42                         ] 

[66 

54-4 

3051 

85 

43                          J 

171.5 

60.5 

2835 

84 

44                          1 

174 

69 

2.521 

84 

45                          1 

183 

695 

2.633 

84 

46                          ] 

[76 

52.4 

3368 

84 

47                          l 

173.9 

66.3 

2.623 

84 

48                          l 

[63.6 

526 

3-HO 

84 

49                         l 

174.4 

595 

2.931 

83 

50                         l 

179 

68.5 

2.613 

83 
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Ratio 

Int. 

No. 

Height 

Wdght 

H:W 

Scot 

51 

171 

58.6 

2.918 

83 

52 

164.9 

70 

2356 

82 

53 

174.4 

644 

2.708 

82 

54 

174 

60.8 

2.861 

82 

55 

168.8 

55-7 

3030 

8l 

56 

166.6 

60 

2.777 

8l 

57 

166 

63 

2635 

8l 

58 

162 

48 

3-375 

80 

59 

183.2 

67 

2734 

80 

60 

1793 

70.2 

2.554 

80 

61 

169.I 

65 

2.602 

79 

62 

1754 

6l 

2.875 

79 

63 

164 

46 

3565 

78 

64 

I59.I 

65   • 

2.448 

78 

65 

I70 

56.6 

3003 

77 

66 

157-7 

59 

2673 

76 

67 

162.5 

62 

2.621 

75 

68 

169.6 

61.3 

2.767 

74 

69 

166.3 

68.3 

2435 

74 

70 

184 

61. 1 

301 1 

74 

71 

182 

695 

2.619 

73 

72 

162 

63 

2.571 

73 

73 

168.7 

66.3 

2544 

72 

74 

163.4 

592 

2.760 

72 

75 

172 

69.2 

2.485 

72 

76 

I8I.6 

72 

2.522 

71 

77 

161 

66.5 

2.421 

69 

78 

180.I 

68.4 

2633 

69 

79 

173 

56 

3.089 

69 

80 

171.8 

56 

3.068 

68 

81 

177.4 

68.2 

2.601 

68 

82 

169 

55-6 

3219 

68 

83 

176 

66.5 

2647 

68 

84 

170.3 

543 

3136 

67 

85 

165 

62.2 

2.653 

66 

86 

176.5 

66 

2.674 

66 

87 

I7I.5 

83 

2.066 

66 

88 

I7I.5 

61 

2.811 

65 

89 

170 

67 

2-537 

65 

90 

171.4 

62 

2.764 

65 

91 

168.3 

56 

3005 

65 

92 

177 

68 

2.603 

65 

93 

166.4 

742 

2243 

65 

94 

1795 

74-5 

2.409 

64 

95 

178.3 

64.7 

2756 

64 

96 

176 

655 

2.687 

64 

97 

163.3 

60 

2.722 

62 

98 

176.5 

73-8 

2.392 

62 

99 

172.2 

649 

2.653 

60 

IOO 

1*1 

81.4 

2.297 

59 
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TABLE  II 

Ratio 

Int. 

No. 

Height 

Weight 

H:W 

score 

1 

175.5 

6l. I 

2.872 

71 

2 

182.7 

62 

2947 

95 

3 

1637 

493 

3.320 

78 

4 

184 

6l. I 

3.01 1 

74 

5 

I83.2 

66.2 

2.767 

98 

6 

172.8 

544 

3.176 

93 

7 

173.5 

62.2 

2.789 

73 

8 

176.5 

58 

3043 

60 

9 

182.3 

70 

2.604 

79 

10 

175.8 

61.8 

2.845 

85 

11 

1799 

634 

2.837 

87 

12 

164.9 

637 

2.60I 

97 

*3 

154 

476 

3235 

107 

H 

166 

54 

3.074 

104 

15 

l675 

543 

3085 

71 

16 

1 79. 1 

68 

2634 

97 

17 

166 

56.2 

2954 

104 

18 

1635 

51.6 

3169 

96 

19 

I7I.7 

59 

2.9IO 

IOI 

20 

180.4 

746 

2.418 

88 

21 

178.8 

79 

2.263 

00 

22 

177 

68 

2.603 

91 

23 

170.8 

61. 1 

2.795 

65 

24 

1597 

573 

2.787 

59 

25 

172.2 

649 

2.653 

60 

26 

1 83. 1 

71 

2.579 

54 

27 

1748 

73-2 

2.388 

59 

28 

172 

479 

3591 

108 

29 

172 

60.2 

2.857 

105 

30 

167.4 

56 

2989 

104 

31 

1743 

60.6 

2.876 

in 

32 

172.2 

58 

2.969 

108 

33 

165.8 

51 

3-251 

no 

34 

186.5 

59 

3.I6I 

112 

35 

I78 

54 

3305 

112 

36 

1573 

58 

2.712 

108 

37 

175.3 

60 

2.922 

108 

38 

176 

60.3 

2.919 

112 

39 

178.8 

62 

2.884 

no 

40 

180.5 

62.8 

2.874 

114 

41 

173 

58 

2.983 

107 

42 

174.8 

67.2 

2.601 

107 

43 

185.4 

70.3 

2.637 

108 

44 

167.5 

53 

3l60 

109 

45 

171.7 

52.7 

3-258 

in 

46 

179.2 

66.3 

2.70I 

79 

47 

1743 

592 

2.944 

93 

48 

176.7 

66.8 

2645 

102 

49 

179.2 

60.9 

2.942 

79 
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Ratio 

No.                         Height 

Weight 

H:W 

50                            1 

174 

67 

2.597 

51                            1 

168.5 

60 

2.808 

52                            1 

179 

61.6 

2.906 

53                            1 

1 70. 1 

594 

2.864 

54                         ^ 

163.7 

55.2 

2065 

55                        1 

179.9 

71 

2534 

56                        1 

[71.2 

61.2 

2797 

57                       J 

170 

62.2 

2733 

58                       J 

161.4 

50 

3-228 

59                       J 

172 

68.3 

2.518 

60                       ] 

1794 

68.4 

2.623 

61                        1 

159.5 

50.8 

3.139 

62                       1 

178.5 

72.6 

2.486 

63                       1 

1732 

66 

2.624 

64                       1 

176.5 

66.2 

2.666 

65                       1 

160.2 

54-8 

2.923 

66 

173.4 

62.2 

2.788 

67 

179 

68.6 

2.609 

68                         1 

181.8 

86 

2.114 

69 

167.3 

59-2 

2.826 

70                         1 

175 

534 

3277 

71                         1 

[76.1 

60.6 

2.906 

72                         ] 

[81 

68.2 

2654 

73                        1 

163.4 

61.4 

2.661 

74                        1 

170.5 

62 

2750 

75                        1 

176 

69 

2.551 

76                        1 

171 

58.8 

2.908 

77                       i 

1736 

77.8 

2.231 

78                       1 

[65.5 

66.4 

2492 

79                        1 

171.9 

69 

2.491 

80                        i 

[62.7 

48 

3389 
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TABLE  HI 

Ratio 

Int. 

low                           Height 

Weight 

H:W 

Score 

I                             ] 

171 

593 

2.883 

"7 

2                                 1 

165 

645 

2.558 

114 

3                         J 

172 

479 

3591 

108 

4                         l 

[66 

62.1 

2.673 

107 

5                        ] 

154 

476 

3235 

107 

6                        : 

166 

56.2 

2954 

104 

7                              3 

[66 

54 

3.074 

104 

8                       i 

164.1 

59 

2.781 

103 

9                        3 

[82 

73 

2493 

I02 

10                               1 

[66.5 

55 

3.027 

IOO 

ii                      i 

[76 

598 

2943 

98 

12                              1 

[64 

48.1 

3.41 1 

97 

13 

[69 

56.8 

2.975 

95 

"4 

"775 

69 

2572 

94 

15 

175 

52.7 

3320 

93 

16 

164.5 

63 

2.6l  I 

93 

17 

[70 

60.4 

2.814 

91 

18 

171 

594 

2.879 

90 

»9 

1 55. 1 

43.1 

3565 

89 

20 

[69 

61 

2.77O 

89 

21 

149.5 

535 

2794 

88 

22                               1 

[68 

65 

2.584 

88 

23 

173 

64.6 

2.678 

87 

24 

174 

55 

3163 

87 

25 

183 

67.2 

2.723 

86 

26 

[86.5 

77.8 

2397 

86 

27 

170.5 

76.5 

2.229 

86 

28 

171 

64.4 

2655 

86 

29 

177 

553 

3.201 

86 

30 

175 

65 

2.692 

86 

31 

167 

58 

2.879 

86 

32 

170.5 

58 

2939 

85 

33 

[82 

73 

2.493 

85 

34 

175 

64 

2734 

85 

35 

[66 

544 

3051 

85 

36 

[68 

65 

2.585 

84 

37 

[66 

5i 

3362 

84 

38 

171-5 

60.5 

2.835 

84 

39 

174 

69 

2.521 

84 

40 

179 

68.5 

2.613 

83 

41 

[70 

69.9 

2432 

83 

42                             1 

[61.5 

75 

2.153 

83 

43                          J 

177 

69.4 

2.550 

83 

44                          ^ 

174 

60.8 

2.861 

82 

45                          1 

[64 

52.1 

3.147 

82 

46                          ] 

178 

675 

2.637 

82 

47                          1 

176 

572 

3077 

81 

48                          ] 

[66 

63 

2.635 

81 

49                         ^ 

174 

62.1 

2.802 

80 
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TABLE  III— (Continued) 


Ratio 

Int. 

No. 

Height 

Weight 

H:W 

Score 

50 

168 

56.4 

2.979 

79 

51 

172 

657 

2.6l8 

79 

52 

164 

59 

2.779 

78 

53 

171 

61.5 

2.780 

78 

54 

186 

72 

2.583 

78 

55 

171 

62.7 

2.727 

76 

56 

157 

56.8 

2763 

75 

57 

178.5 

673 

2.652 

74 

58 

1 60 

543 

2946 

74 

59 

167 

60.8 

2747 

74 

60 

184 

61. 1 

3.01 1 

74 

61 

182 

695 

2.619 

73 

62 

175 

68.6 

2.551 

73 

63 

163 

56 

2.9IO 

73 

64 

162 

63 

2.571 

73 

65 

178 

63 

2.825 

72 

66 

157 

63 

2492 

72 

67 

163.5 

63 

2595 

72 

68 

1575 

52 

3.028 

70 

69 

175 

79 

2.215 

70 

70 

176 

66.5 

2647 

68 

71 

174 

572 

3.04I 

68 

72 

171 

54 

3167 

66 

73 

177 

68 

2.603 

65 

74 

172 

65 

2.646 

63 

75 

171 

63.1 

2.714 

55 
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TABLE  IV 

% 

Length 
Limbs 

Volume 

Morphologic 

No. 

Int. 

Trunk 

Index 

I 

79 

136 

26.73 

5.08 

2 

63 

140 

26.88 

5.21 

3 

80 

142 

24.70 

575 

4 

»7 

I44 

21.57 

6.67 

5 

88 

122 

20.99 

5.8l 

6 

103 

133 

20.18 

6.59 

7 

70 

I44 

2956 

4.87 

8 

87 

142 

2M5 

6.62 

9 

86 

149 

26.71 

558 

IO 

68 

145 

28.72 

504 

ii 

93 

145 

21.24 

6.82 

12 

86 

139 

31.92 

435 

13 

95 

139 

2I.Q2 

6.61 

14 

86 

153 

32.08 

477 

15 

83 

141 

30.05 

4.69 

16 

89 

126 

20.26 

6.22 

17 

79 

137 

21.79 

6.28 

18 

84 

140 

26.15 

535 

19 

76 

136 

28.85 

471 

20 

66 

129 

22.49 

5-73 

21 

72 

132 

26.53 

.     497 

22 

83 

138 

28.96 

476 

23 

83 

I30 

29.86 

435 

24 

84 

138 

19.12 

7.21 

25 

86 

142 

22.77 

6.23 

26 

88 

142 

24.68 

5-75 

27 

84 

142 

2556 

5.55 

28 

86 

H5 

26.73 

542 

29 

65 

142 

2523 

562 

30 

73 

133 

24.20 

549 

31 

86 

139 

24.18 

5-74 

32 

85 

I49 

31.31 

475 

33 

74 

I40 

29.62 

4-72 

34 

108 

136 

19.91 

6.83 

35 

107 

133-5 

24-59 

543 

36 

104 

135 

24-34 

554 

37 

74 

126 

26.41 

477 

38 

78 

157.5 

25.38 

6.20 

39 

91 

I40 

22.33 

6.27 

40 

114 

137 

22.39 

6.11 

41 

73 

144-5 

2509 

5-75 

42 

85 

1395 

20.65 

6.75 

43 

84 

144 

26.08 

5.52 

44 

74 

146 

27.81 

5.25 

45 

55 

1385 

2573 

5.38 

46 

97. 

133 

21.75 

6.1 1 

47 

75 

129.5 

23.04 

562 

48 

104 

138 

22.80 

6.05 

49 

100 

142 

22.32 

6.36 
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TABLE  IV- 

-(Continued) 

No. 

Int. 

Length 
Limb* 

Volume 
Trunk 

Morphologic 
Index 

50 

81 

132 

27.91 

473 

51 

9« 

1435 

22.47 

6.38 

52 

68 

138 

23.96 

596 

53 

82 

140 

21.09 

6.63 

54 

73 

139 

26.42 

526 

55 

87 

138 

25.09 

550 

56 

86 

141 

21.19 

6.65 

57 

102 

145 

28.21 

5.14 

58 

82 

146 

26.48 

551 

59 

93 

136.5 

23-39 

583 

60 

86 

136 

24.73 

549 

61 

83 

143 

2519 

567 

62 

85 

138 

2478 

557 

63 

72 

129 

23.88 

5-40 

64 

73 

136 

2315 

588 

65 

72 

138 

23.66 

583 

66 

78 

136 

20.45 

6.65 

67 

74 

138 

2553 

5-40 

68 

90 

142 

24.20 

5-86 

69 

81 

144 

23.86 

6.03 

70 

89 

137 

2454 

558 

71 

70 

130 

1959 

6.63 

72 

94 

148.5 

28.39 

523 

73 

82 

134 

2479 

4.82 

74 

107 

126.5 

1757 

7.20 

75 

78 

133 

2372 

5-6o 
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TABLE  V 

Ratio 

Int. 

No.                           Height 

Weight 

H:W 

Score 

I                              1 

171 

593 

2.883 

"7 

2                                1 

[80.5 

62.8 

2.874 

114 

3                         ] 

165 

645 

2.558 

114 

4                          ] 

[86.5 

59 

3l6l 

112 

5                         J 

178.5 

54 

3.305 

112 

6                         i 

[76 

60.3 

2.919 

112 

7                          1 

174.3 

60.6 

2.876 

III 

8                          i 

[71.7 

52.7 

3258 

III 

9                          ^ 

165.8 

51 

3.25I 

1 10 

10                             i 

171 

58.8 

2.908 

1 10 

ii                        i 

[78.8 

62 

2.884 

I IO 

12                                 1 

167.5 

53 

3.l60 

IO9 

13                        ] 

[72 

479 

3591 

108 

14                         l 

157.3 

58 

2.712 

108 

15                         ] 

[72.2 

58 

2969 

108 

16                          i 

185.4 

70.3 

2.637 

108 

17                        i 

175.3 

60 

2.922 

I08 

18                          l 

[66 

62.1 

2.673 

107 

19                          J 

154 

476 

3-235 

107 

20                                1 

174.8 

67.2 

2.601 

I07 

21                                  1 

173 

58 

2.983 

I07 

22                                  1 

172 

60.2 

2.857 

105 

23                                   ] 

167.4 

56 

2.989 

IO4 

24                            1 

[66 

56.2 

2954 

IO4 

25                                 ] 

[66 

54 

3074 

IO4 

26                                 1 

[70.1 

594 

2.864 

IO3 

27                            1 

179 

68.6 

2.609 

IO3 

28                              ] 

165 

53-1 

3.107 

IO3 

29                            1 

[64.1 

59 

2.781 

103 

30                 ] 

176.7 

66.8 

2645 

102 

31                 ] 

[82 

73 

2493 

102 

32                 ] 

184.5 

54-2 

3404 

101 

33                         ] 

[67.6 

61.2 

2.739 

101 

34                         ] 

[71.2 

61.2 

2.797 

101 

35                         ] 

[81 

68.2 

2.654 

101 

36                         1 

[76 

69 

2.551 

IOI 

37                         1 

[71.7 

59 

2.910 

IOI 

38                         1 

1744 

647 

2695 

100 

39                         1 

[70 

62.3 

2.729 

IOO 

40                         1 

178.5 

72.6 

2.486 

IOO 

41                          ) 

[66.5 

55 

3-027 

IOO 

42                         ) 

163.4 

61.4 

2.661 

99 

43                          ] 

165.5' 

60.1 

2754 

99 

44                          : 

183.2 

66.2 

2767 

98 

45                         ] 

173 

62.5 

2.768 

98 

46                         1 

[62.8 

56.4 

2.887 

98 

47                         ] 

[61.4 

50 

3228 

98 

48                         1 

[76 

59-8 

2943 

98 

49                         ] 

163.7 

55.2 

2.965 

97 

36 
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TABLE  V— (Continued) 


Ratio 

Int 

No. 

Height 

Weight 

H:W 

Scot 

50 

164 

48.I 

34" 

97 

51 

I64.9 

634 

2.60I 

97 

52 

1 79. 1 

68 

2634 

97 

53 

1635 

51.6 

3169 

96 

54 

182.7 

62 

2.947 

95 

55 

I69 

56.8 

2.975 

95 

56 

167 

78.6 

2.125 

94 

57 

1775 

69 

2.572 

94 

58 

I77.I 

55.8 

3.174 

93 

59 

1743 

59-2 

2944 

93 

60 

175 

52.7 

3320 

93 

61 

I64.5 

63 

2.6l  I 

93 

62 

172.8 

544 

3176 

93 

63 

I62.5 

70.1 

2.318 

92 

64 

177 

68 

2.603 

91 

65 

178 

57.2 

3"2 

91 

66 

165.4 

51. 1 

3236 

91 

67 

170 

60.4 

2.814 

91 

68 

168.4 

593 

2.840 

90 

69 

178.8 

79 

2.263 

90 

70 

171 

594 

2.879 

90 

71 

ISM 

431 

3.598 

89 

72 

171 

60.8 

2.812 

89 

73 

174 

67 

2.597 

89 

74 

173.4 

62.2 

2.788 

89 

75 

I69 

61 

2.770 

89 

76 

1495 

53-5 

2.794 

88 

77 

180.I 

84.8 

2.124 

88 

78 

I66.5 

65 

2.562 

88 

79 

168 

65 

2.584 

88 

80 

180.4 

74-6 

2.418 

88 

81 

I67 

53 

3.151 

87 

82 

170.4 

58.1 

2.933 

87 

83 

176.5 

66.2 

2.666 

87 

84 

173 

64.6 

2.678 

87 

85 

1799 

634 

2.837 

87 

86 

165.5 

66.4 

2.492 

87 

87 

174 

55 

3163 

87 

88 

183 

67.2 

2723 

86 

89 

186.5 

77.8 

2397 

86 

90 

165 

54-2 

3044 

86 

91 

175-5 

58.9 

2.980 

86 

92 

I8I.6 

60.7 

2.992 

86 

93 

170.5 

76.5 

2.229 

86 

94 

171 

644 

2655 

86 

95 

177 

553 

3.201 

86 

96 

175 

65 

2.692 

86 

97 

167 

58 

2.879 

86 

98 

170.5 

58 

2939 

85 
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TABLE  V— {Continued) 


Ratio 

Int. 

No.                            Height 

Weight 

H:W 

Soot 

99                          1 

178 

634 

2.808 

«5 

IOO                                 ] 

176.1 

596 

2.955 

«5 

IOI                                  ] 

794 

68.4 

2.623 

«5 

102                                  ] 

[81.8 

86 

2. 1 14 

85 

I03                                  1 

[82 

73 

2493 

«S 

IO4                                 1 

175 

64 

2.734 

85 

IO5                                 1 

75.8 

61.8 

2.845 

85 

106                                 1 

[66 

54.4 

3.05I 

85 

I07                                 ] 

183 

695 

2633 

84 

IO8                                 ] 

176.5 

52.4 

3368 

84 

IO9                                 ] 

1739 

66.3 

2.623 

84 

I IO                 •                1 

163.6 

52.6 

3.1 10 

84 

III                                  1 

[68 

65 

2.585 

84 

112                                1 

171.5 

51 

3362 

84 

"3                         1 

I7I.5 

60.5 

2.835 

84 

114                 ] 

174 

69 

2.521 

84 

"5                        1 

174.4 

595 

2.931 

83 

116                        \ 

179 

68.* 

2.613 

83 

117                        1 

171 

58.6 

2.918 

83 

118                        ] 

170 

69.9 

2.432 

83 

119                        ] 

161.5 

75 

2.153 

83 

120                        ] 

i"77 

694 

2.550 

83 

121                        1 

164.9 

70 

2356 

82 

122                        1 

1744 

644 

2.708 

82 

123                        ] 

174 

60.8 

2.861 

82 

124                        1 

[64 

52.1 

3.147 

82 

125                        ] 

178 

675 

2637 

82 

126                        ] 

[68.8 

557 

3030 

81 

127                        ] 

[66.6 

60 

2.777 

81 

128                        ] 

[68.5 

60 

2.808 

81 

129                        ] 

173.6 

778 

2.23I 

81 

130                        1 

[76 

57.2 

3-077 

81 

131                        1 

[66 

63 

2.635 

81 

132                        1 

[62 

48 

3375 

80 

133                                3 

[83.2 

67 

2.734 

80 

134                                ' 

1793 

70.2 

2554 

80 

135                                1 

174 

62.1 

2.802 

80 

136                                1 

[69.1 

65 

2.602 

79 

137                                ' 

1754 

61 

2.875 

79 

138                                1 

[82.3 

70 

2.604 

79 

139                                1 

[791 

66.3 

2.701 

79 

140                       : 

179.2 

60.9 

2.942 

79 

141                       1 

[68 

56.4 

2.979 

79 

142                       1 

[72 

657 

2.6l8 

79 

143                       ^ 

[64 

59 

2.779 

78 

144                       1 

[64 

46 

3565 

78 

145                       1 

I59.I 

65 

2.448 

78 

146                       i 

163.7 

49-3 

3-320 

78 

147                       1 

179-9 

71 

2.534 

78 

3» 
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TABLE  V— (Continued) 


Ratio 

lot 

No. 

Height 

Weight 

H:W 

Scot 

I48 

171 

61.5 

2.780 

78 

149 

186 

72 

2.583 

7« 

150 

170 

56.6 

3.003 

77 

151 

1673 

592 

2.826 

77 

152 

170.5 

62 

2.750 

77 

153 

1577 

59 

2673 

76 

154 

175 

534 

3-277 

76 

155 

171 

62.7 

2.727 

76 

156 

162.5 

62 

2.621 

75 

157 

157 

56.8 

2.764 

75 

158 

178.5 

673 

2.652 

74 

159 

169.6 

61.3 

2767 

74 

160 

166.3 

68.3 

2.435 

74 

I6l 

179 

61.6 

2.906 

74 

162 

160 

54.3 

2046 

74 

163 

167 

60.8 

2.747 

74 

I64 

184 

61. 1 

30I I 

74 

165 

182 

695 

2.619 

73 

166 

1735 

62.2 

2.789 

73 

167 

175 

68.6 

2.551 

73 

168 

163 

56 

2.9IO 

73 

169 

162 

63 

2.571 

73 

170 

168.7 

66.3 

2.544 

72 

171 

163.4 

59.2 

2.760 

72 

172 

172 

69.2 

2.485 

72 

173 

178 

63 

2.825 

72 

174 

157 

63 

2.492 

72 

175 

163.5 

63 

2.595 

72 

176 

I8I.6 

72 

2.522 

71 

177 

167.5 

543 

3085 

71 

178 

159.5 

50.8 

3-139 

71 

179 

160.2 

54.8 

2.923 

7i 

180 

175.5 

61.1 

2.872 

7i 

I8l 

157.5 

52 

3028 

70 

182 

175 

79 

2.215 

70 

183 

l6l. I 

66.5 

2.421 

69 

184 

180 

68.4 

2633 

69 

185 

173 

56 

3.089 

69 

186 

127.6 

48 

3389 

69 

187 

I7I.8 

56 

3.068 

68 

188 

1774 

68.2 

2.60I 

68 

189 

179 

55-6 

3.219 

68 

190 

172 

68.3 

2.518 

68 

191 

176 

66.5 

2.647 

68 

192 

174 

57-2 

304I 

68 

193 

170.3 

543 

3136 

67 

194 

171 

54 

3l67 

66 

195 

165 

62.2 

2653 

66 

196 

176.5 

66 

2674 

66 
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TABLE  V— (Continued) 


- 

Ratio 

Int. 

No.                              Height 

Weight 

H:W 

Score 

197                              1 

•71.5 

«3 

2.066 

66 

198                              ] 

171.5 

61 

2.8l  I 

63- 

199                              1 

[70 

67 

2537 

65 

200                              ] 

I7M 

62 

2.764 

65 

20I                              ] 

[68.3 

56 

3.005 

65 

202                              ] 

[66.4 

74.2 

2243 

65 

203                              ] 

[70 

62.2 

2.733 

65 

204                              ] 

[76.I 

60.6 

2.906 

65 

205                              ] 

177 

68 

2.603 

65 

206                              1 

170.8 

61. 1 

2.795 

65 

207                              1 

1795 

74.5 

2.409 

64 

208                              ] 

178.3 

647 

2756 

64 

209                              ] 

[76 

•      65.5 

2.687 

64 

2IO                              ] 

[71.9 

69 

2.491 

63 

211                                ] 

[72 

65 

2.646 

63 

212                                 1 

163.3 

60 

2.722 

62 

213                                 ] 

176.5 

738 

2.392 

62 

214                                 ] 

[72.2 

64.9 

2653 

60 

215                                 1 

176.5 

58 

3.043 

60 

216                                 ] 

174.8 

73.2 

2.388 

59 

217                                 ] 

[87 

81.4 

2.297 

59 

218                                 1 

173.2 

66 

2.624 

59 

219                                 I 

1597 

573 

2.787 

59 

220                                 1 

'71 

63 

2.714 

55 

221                                  1 

183. 1 

71 

2579 

54 

40 


The  Morphologic  Aspect  of  Intelligence 


TABLE  VI 

No. 

Int. 
score 

Lung 
Capacity 

No. 

Int. 
Score 

Lung 
Capacity 

I 

»7 

460 

50 

86 

400 

2 

114 

350 

51 

85 

465 

3 

107 

450 

52 

85 

330 

4 

107 

250 

53 

85 

400 

5 

104 

390 

54 

85 

565 

6 

104 

400 

55 

85 

410 

7 

103 

390 

56 

85 

360 

8 

103 

320  • 

57 

84 

470 

9 

102 

450 

58 

84 

390 

10 

101 

435 

59 

84 

460 

ii 

101 

390 

60 

84 

370 

12 

100 

360 

61 

84 

340 

13 

100 

430 

1   62 

84 

380 

H 

100 

330 

63 

84 

380 

15 

99 

240 

64 

84 

460 

16 

9* 

340 

65 

83 

350 

17 

9* 

250 

66 

83 

480 

18 

9* 

350 

67 

83 

370 

19 

97 

300 

68 

83 

4IO 

20 

95 

280 

69 

82 

290 

21 

94 

400 

70 

82 

440 

22 

94 

440 

71 

82 

400 

23 

93 

410 

72 

82 

320 

24 

93 

400 

73 

82 

330 

25 

93 

430 

74 

81 

460 

26 

92 

350 

75 

81 

38o 

27 

91 

410 

76 

81 

400 

28 

9i 

350 

77 

81 

400 

29 

90 

410 

78 

80 

330 

30 

90 

410 

79 

80 

440 

31 

89 

260 

80 

80 

420 

32 

89 

390 

81 

80 

420 

33 

89 

470 

82 

79 

420 

34 

88 

330 

83 

79 

390 

35 

88 

350 

84 

79 

350 

36 

88 

380 

85 

79 

460 

37 

88 

400 

86 

78 

350 

38 

87 

300 

87 

78 

230 

39 

87 

330 

88 

78 

350 

40 

87 

420 

89 

78 

370 

4i 

86 

500 

90 

77 

430 

42 

86 

450 

91 

76 

3IO 

43 

86 

300 

92 

75 

430 

44 

86 

440 

93 

75 

240 

45 

86 

370 

94 

74 

38o 

46 

86 

480 

95 

74 

250 

47 

86 

380 

96 

74 

380 

48 

86 

370 

97 

74 

360 

49 

86 

35o       1 

98 

74 

4IO 
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TABLE  VI 

—(Continued) 

No. 

Int. 
acore 

Lung 
Capacity                No. 

Int. 
Score 

Lunj 
Capadi 

99 

73 

360 

118 

68 

3«0 

100 

73 

340 

119 

67 

330 

101 

73 

350 

120 

66 

410 

102 

73 

410 

121 

66 

470 

103 

72 

360 

122 

66 

360 

104 

72 

3*> 

123 

65 

330 

105 

72 

360 

124 

65 

400 

106 

72 

330 

125 

65 

50O 

107 

72 

340 

126 

65 

350 

108 

7i 

420 

127 

65 

370 

109 

70 

320 

128 

65 

340 

110 

70 

4IO 

129 

64 

450 

in 

69 

420 

130 

64 

390 

112 

69 

470 

131 

64 

500 

"3 

69 

410 

132 

63 

330 

114 

68 

460 

133 

62 

300 

"5 

68 

460 

134 

62 

410 

116 

68 

350 

135 

59 

520 

"7 

68 

450 

136 

55 

44© 
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TABLE  VII 

Length 

Volume 

Morph.      Height 

Weight 

Ratio 

No. 

Limbs 

Trunk 

Index       i 

ncm. 

in  lbs. 

H:W 

I 

126.5 

18.84 

67I        ] 

157.5 

"3 

139 

2 

123.9 

20.28 

6lO        1 

152 

98 

155 

3 

139-4 

24.19 

576        1 

173 

I20 

144 

4 

140.2 

2570 

545      J 

172.5 

135 

127 

5 

1295 

24.60 

526      : 

[61 

121 

133 

6 

136 

2597 

523      J 

[66 

"5 

144 

7 

I3».  I 

26.50 

521       1 

171-5 

135 

127 

8 

I4I.6 

2740 

516      1 

[69 

124 

136 

9 

I46.7 

28.50 

514      1 

179- 

135 

132 

10 

1577 

30.69 

513      1 

187.5 

I76 

I06 

ii 

I50.3 

2940 

5ii       1 

178.5 

128 

139 

12 

1455 

28.67 

507      1 

172 

132 

130 

13 

152.4 

30.31 

502      1 

[81 

133 

136 

14 

156.5 

31.32 

499       1 

[91 

145 

131 

15 

134-7 

27.40 

491       1 

[69 

128 

132 

16 

132.3 

26.97 

490       1 

[66 

121 

137 

17 

H7-3 

2970 

495       1 

[81 

I46 

123 

18 

144 

30.18 

477       i 

172.2 

145 

119 

19 

H3 

30.OO 

476       1 

174-5 

160 

I09 

20 

144.4 

30.44 

474       i 

179 

151 

Il8 

21 

1456 

31-30 

465       1 

179 

139 

128 

22 

1465 

31.80 

460       1 

[78 

149 

119 

23 

142.7 

31-00 

460       1 

183.5 

I46 

125 

24 

136.3 

30.IO 

452       1 

[70 

126 

134 

25 

140 

31.20 

448       1 

[81 

155 

Il6 

26 

1456 

32.70 

445       3 

[81 

I60 

113 

27 

133.8 

30.41 

440       ] 

[72 

131 

131 

28 

I44-I 

3253 

442       i 

179 

145 

123 

29 

137 

3143 

436       1 

167 

145 

115 

30 

1381 

31.73 

435       1 

'71-5 

135 

127 

31 

138.4 

32.OO 

432       1 

[70 

I46 

116 

32 

130.8 

30.70 

426       1 

162.5 

135 

120 

33 

141 

33-04 

426       1 

t7i 

145 

117 

34 

140.3 

33-51 

418       i 

[72 

144 

119 

35 

144.9 

34-77 

416       1 

[80 

158 

114 

36 

155 

3751 

413       1 

[89 

175 

I08 

37 

1326 

3246 

408       ] 

[70 

145 

U7 

38 

144.9 

35-44 

408       ] 

177 

166 

IO6 

39 

137-6 

34.61 

397       1 

[64 

147 

III 

40 

1344 

33-83 

397       1 

173-5 

142 

122 

4i 

142.4 

35-90 

396       1 

175.5 

165 

IO6 

42 

127.7 

32.02 

398       1 

167.5 

I30 

128 

43 

138.8 

35.83 

387       1 

172.5 

150 

"5 

44 

142.2 

3705 

383       1 

t775 

154 

114 

45 

138.8 

36.34 

381    .   i 

[72 

150 

115 

46 

145-5 

38.34 

379       1 

[80 

165 

109 

47 

138.2 

36.68 

376       i 

[70 

I6l 

105 

48 

130.6 

3500 

373       1 

175 

152 

115 

49 

H8.5 

40.68 

365       J 

[80.5 

175 

103 

< 

132 

tf>S1 

**>**>      ^ 

i*\<* 

160 

I06 
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SYNOPSIS  OF  THE  TABLES 

Tables  No.  I,  II  and  III  give  height  (cm.),  weight  (kg.)  ratio  height  to 
weight  and  intelligence  ratings  (Thorndike  Intelligence  Examination)  of 
groups  of  100,  80  and  75  college  students. 

Table  No.  V  gives  the  same  subjects  of  tables  I,  II  and  III  in  a  single 
group  of  22 1 .   Some  subjects  appeared  in  more  than  one  table. 

Table  No.  IV  gives  length  of  limbs,  volume  of  trunk  and  morphologic 
index  of  the  same  individuals  of  table  No.  III. 

Table  No.  VI  gives  lung  capacity  of  136  subjects  among  the  group  of 
table  V. 

Table  VII — giving  length  of  limbs,  volume  of  trunk,  morpholog'c  index, 
height,  weight  and  ratio  of  height  to  weight  in  a  group  of  50  University 
students. 
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SECTION  I 
HISTORY  OF  FRESHMAN  TESTS 

The  recommendation  in  1882  by  Galton  *  of  the  establishment 
of  anthropometric  and  medico-metric  laboratories  for  the  examina- 
tion of  individuals  represents  the  first  definite  recognition  of  the 
need  of  examining  individuals  in  order  to  give  them  vocational 
guidance.  Galton  saw  the  importance  both  to  science  and  to 
individuals  of  collecting  complete  life-histories  of  people  which 
should  include  photographs,  anthropometric  measurements,  and 
medical  facts.  To  meet  this  need  he  established  his  now  famous 
laboratory  in  the  South  Kensington  Museum,  London.  There,  by 
payment  of  a  small  fee,  individuals  could  go  and  have  certain 
physical  measurements  made  and  undergo  tests  for  keenness  of 
vision  and  hearing,  dynamometer  pressure,  reaction  time,  etc. 

Several  years  later,  at  the  World's  Columbia  Exposition  in  1893,* 
Professor  Joseph  Jastrow  arranged  a  laboratory  devoted  to  tests 
of  a  strictly  psychological  nature.  Prior  to  Jastrow's  work,  however, 
Cattell  proposed  *  and  tried  out  a  series  of  ten  mental  tests  and 
measurements  on  students  in  the  psychological  laboratory  of  the 
University  of  Pennsylvania.  In  devising  his  series  of  tests  Cattell 
followed  Galton  in  combining  physical  measurements  with  psy- 
chophysical and  strictly  mental  tests.  He  went  a  step  farther, 
however,  by  emphasizing  the  necessity  of  standardizing  methods  of 
procedure  in  administering  tests  so  that  results  secured  by  different 
experimenters  might  be  comparable.  In  addition  to  the  Pennsyl- 
vania students,  tests  were  also  given  to  the  students  of  Cambridge 
University  and  Bryn  Mawr  College. 

Galton's  work  stimulated  other  investigators  to  devise  tests  for 
measuring  the  capacities  of  individuals.  Of  particular  interest  is 
the  list  of  ten  fundamental  traits  or  properties  proposed  by  Kraepe- 
lin  *  as  the  basic  factors  to  be  considered  in  examining  both  normal 
individuals  and  the  "mentally  sick."  These  so-called  fundamental 
dispositions  include:  the  mental  capacity  to  do  work,  the  ability  to 

1  Fortnightly  Review,  1882,  p.  333. 

*  Cattell  and  Farrand,  L.  Physical  and  Mental  Measurements  of  the  Students  of  Columbia 
University. 

•  "Mental  Tests  and  Measurements,"  J.  McK.  Cattell  with  appendix  by  Francis  Galton,  Mind, 
1890. 

4Der  Psychologische  Versuch  in  der  Psychiatrie;  Emil  Kraepelin,  Psychologische  Arbeiten, 
1*95- 
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be  influenced  by  practice,  strength  of  practice  or  general  memory, 
special  memory  ability,  susceptibility,  fatigability,  the  ability  to 
recuperate,  the  depth  of  sleep,  the  intensity  of  distraction  and 
adaptability.  To  each  one  of  these  fundamental  traits  Kraepelin 
arbitrarily  assigned  a  certain  test,  assuming  that  excellence  of 
performance  in  the  assigned  test,  say  adding,  would  indicate  excel- 
lence in  the  corresponding  quality,  say  the  capacity  to  do  work. 
Although  his  assumption,  without  statistical  proof,  that  certain 
tests  would  measure  certain  functions  rendered  his  results  inac- 
curate, from  the  modern  standpoint,  his  work  is  interesting  in  that 
it  is  representative  of  a  distinct  stage  in  the  use  of  tests  for  diag- 
nostic purposes. 

With  the  accumulation  of  data  and  the  gradually  increasing 
clearness  of  conception  of  the  meaning  of  tests,  methods  of  admin- 
istering them  were  revised.  In  1896  *  appeared  the  first  report  of 
the  results  of  mental  and  physical  tests  made  on  freshmen  only. 
It  concerned  the  work  done  by  Professor  Cattell  and  Dr.  Farrand 
on  one  hundred  Columbia  University  students  in  1894-5  and  1895-6. 
At  this  time  there  was  conceived  the  plan  of  testing  Columbia 
students  during  their  freshman  and  senior  years.  Their  tests 
comprised  ten  records  and  twenty-six  measurements.  Such  physical 
measurements  were  taken  as  the  color  of  hair  and  eyes,  height  and 
weight,  breathing  capacity,  sensation  areas,  and  strength  of  right 
and  left  hands.  Other  measures  were  of  a  sensory  character,  while 
certain  simple  tests  of  a  mental  character  were  taken,  such  as  the 
rate  of  perception  and  the  perception  of  space  and  time.  In  addi- 
tion, a  personal  record-blank  was  filled  out  by  the  student  and  a 
record  of  the  impressions  made  upon  him  by  the  subject  was  filled 
in  by  the  experimenter  both  before  and  after  testing.  The  tests 
were  given  individually,  the  investigators  and  several  assistants 
acting  as  experimenters,  and  required  from  forty  minutes  to  one 
hour  for  their  completion.  The  underlying  purpose  in  giving  these 
tests  is  clearly  stated  in  this  statement  by  Cattell  and  Farrand:* 

"When  used  with  freshmen  on  entering  college  the  record  is  of  interest  to  the 
man  and  may  be  of  real  value  to  him.  It  is  well  for  him  to  know  how  his  physical 
development,  his  senses,  his  movements,  and  his  mental  processes  compare  with 
those  of  his  fellows.  He  may  be  able  to  correct  defects  and  develop  aptitudes. 
Then  when  the  tests  are  repeated  later  in  the  college  course  and  in  subsequent 
life  the  record  of  progress  or  regression  may  prove  of  substantial  importance  to 
the  individual." 

*  Cattell,  J.  McK.,  and  Farrand,  L.  Physical  and  Mental  Measurements  of  the  Students  of 
Columbia  University,  Psychological  Review,  1806,  III,  618-047. 

•  Above  reference. 
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These  Columbia  freshman  tests  continued  to  be  given  each  year 
under  Professor  Cattell's  direction.  In  1901  7  an  account  and 
discussion  of  the  results  was  published  by  Wissler.  He  discusses  the 
changes  and  additions  made  in  the  tests  and  considers  the  records 
of  250  freshmen,  a  small  number  of  seniors,  and  some  Barnard  girls. 
The  tests  employed  were:  length  and  breadth  of  head,  strength  of 
hands,  fatigue,  eyesight,  color-vision,  hearing,  perception  of  pitch, 
perception  of  weight,  sensation  areas,  sensitiveness  to  pain,  per- 
ception of  size,  color  preference,  reaction  time,  rate  of  percep- 
tion, naming  colors,  rate  of  movement,  accuracy  of  movement, 
perception  of  time,  association,  imagery,  memory,  (auditory,  visual, 
logical,  and  retrospective).  Records  of  stature,  weight,  etc.,  to- 
gether with  data  concerning  parentage,  personal  habits,  and  health, 
the  physical  measurements  taken  in  the  gymnasium,  and  academic 
marks  were  also  secured.  From  the  similarity  of  the  results  of 
freshmen  tested  each  year,  Wissler  concluded  that  freshmen  enter- 
ing Columbia  from  year  to  year  are  a  homogeneous  group  and 
represent  a  type.  His  general  conclusions  are: 

1.  That  the  laboratory  mental  tests  show  little  intercorrelation 
in  the  case  of  college  students.  Correlations  range  from  —.28 
(accuracy  and  speed  in  marking  out  A's),  to  +.39  (auditory  and 
visual  memory — correctly  placed). 

2.  That  the  physical  tests  show  a  general  tendency  to  correlate 
among  themselves,  but  only  to  a  very  slight  degree  with  the  mental 
tests. 

3.  That  the  markings  of  students  in  college  classes  correlate  with 
themselves  to  a  considerable  degree.  Correlations  run  from  +.11, 
(mathematics  and  logical  memory)  to  +.75  (Latin  and  Greek). 

These  early  Columbia  tests  and  measurements  were  principally 
motor  and  sensory  in  character,  and  the  few  tests  that  might  be 
considered  to  have  an  intellectual  quality  were  so  simple  that  they 
proved  of  little  value  for  determining  the  mental  status  of  the  college 
freshman.  They  are,  however,  significant  in  that  they  represent  the 
first  definite  attempt  to  establish  standards  of  performance  for 
freshmen  and  to  show  students  how  their  standing  in  various  tests 
compared  with  the  average  standing  of  their  class. 

Subsequent  to  the  establishment  of  the  practice  of  testing  the 
Columbia  students  in  their  freshman  and  senior  years,  committees 
were  appointed  by  the  American  Psychological  Association  in  1896 

*  Wilder,  Clark;  The  Correlation  of  Mental  and  Physical  Tests;  Psychological  Review.  Mono  - 
graph  SuppL.  Vol.  Ill,  No.  xoox,  p.  6a. 
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and  1907,  respectively,  to  consider  the  possibility  of  accumulating 
mental  and  physical  statistics  through  cooperation  on  the  part  of 
various  psychological  laboratories  and  to  devise  a  standard  series 
of  group  and  individual  tests.  In  1896  the  committee  drew  up  a 
series  of  physical  and  mental  tests  appropriate  for  college  students 
tested  in  a  psychological  laboratory. 

Various  other  proposals  were  made  for  the  scientific  study  of  the 
college  student.  In  1899  President  Harper  of  Chicago  recommended 
that  special  study  be  made  of  the  college  student's  character,  intel- 
lectual capacity,  and  tastes,  by  the  questionnaire  method.  In  1906 
Thorndike  *  called  attention  to  the  fact  that  the  entrance  examina- 
tions given  by  the  College  Entrance  Board  of  the  Association  of 
Colleges  and  Preparatory  Schools  of  the  Middle  States  and  Mary- 
land did  not  measure  at  all  accurately  the  candidate's  capacity 
and  emphasized  the  need  of  the  scientific  study  of  this  matter. 
Williams 9  also  stressed  the  importance  of  studying  the  college 
student.  Like  President  Harper,  he  recommended  the  questionnaire 
method  for  ascertaining  facts  concerning  the  student's  personality, 
and  suggested  the  use  of  Whipple's  information  test  for  obtaining 
a  knowledge  of  the  student's  range  of  information.  He  also  pointed 
out  the  need  of  vocational  advisors  for  freshmen. 

Calfee 10  in  191 3  reported  the  results  of  four  general  intelligence 
tests  on  103  freshmen  (51  boys  and  52  girls)  of  the  University  of 
Texas.  The  tests  used  were  card-dealing,  card-sorting,  alphabet- 
sorting,  the  mirror  test,  and  the  spirometer  test  for  vital  capacity. 
She  finds  inter-test  correlations  for  the  boys  and  girls  combined 
ranging  all  the  way  from  +.50  to  .00.  The  correlations  between 
the  tests  and  college  grades  range  from  +.32  (card  sorting  and 
grades)  to  +.16  (mirror  test  and  grades).  The  correlation  between 
the  lung  test  and  grades  is  —.11.  Considering  the  girls'  records 
alone,  the  inter- test  correlations  range  from  +.45  to  +.19,  and 
the  correlations  with  college  grades  from  -f  .28  to  +.13,  and  with 
the  lung  test  the  correlation  is  .00. 

No  further  attempt  to  measure  the  performance  of  college  fresh- 
men in  tests  is  reported  until  December,  1915,  when  Dr.  Karl  T. 
Waugh  presented  a  paper  on  "A  New  Mental  Diagnosis  of  the 
College   Student"   before    the   American    Psychological    Associa- 

■  Thorndike,  E.  L.  An  Empirical  Study  of  College  Entrance  Examination*  Science,  N.&, 
1906.  23.  830-845. 

•  Williams.  C  W.  Scientific  Study  of  the  College  Student. 

"  Calfee,  M.  College  Freshmen  and  Four  General  Intelligence  Testa,  Journ.  of  Educ  PsychoL, 
1913.  4.  223-231. 
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tion.11  In  1912  he  applied  seven  tests  u  individually  to  freshmen  in 
Beloit  College,  and  three  years  later,  in  1915,  he  gave  the  same 
tests  to  thirty-nine  of  the  same  subjects.  Waugh's  inter-test  cor- 
relations range  from  —.43  to  +.54,  and  he  finds  some  improve- 
ment in  the  tests  from  freshman  to  senior  year. 

During  the  year  1913-14  Bingham  u  gave  nine  tests  to  200  Dart- 
mouth freshmen,  seven  of  them  being  given  individually.  As  a 
number  of  psychology  students,  unpracticed  experimenters,  assisted 
Professor  Bingham  in  his  testing,  the  results  of  his  investigation  are 
somewhat  inaccurate.  He  gives  norms  for  the  nine  tests,  (median, 
standard  deviation  and  coefficient  of  variability)  and  the  range 
from  the  poorest  to  the  best.  As  no  correlations  are  reported  we 
have  no  information  as  to  the  relationships  between  the  tests. 
Bingham's  chief  contribution  consists  in  his  use  of  the  method  of 
ogive  percentile  graphs.  The  data  in  seven  of  his  tests  are  presented 
in  this  form,  thus  serving  as  a  scale.  Given  the  score  made  by  any 
individual,  the  experimenter  by  reference  to  the  chart  can  readily 
assign  him  a  rank  among  his  classmates.  The  speed  with  which  a 
student  may  be  thus  assigned  his  relative  position  in  any  given 
trait  makes  this  method  a  most  convenient  one  for  the  instructor.14 

At  the  University  of  Texas  the  same  year  Bell 16  gave  nine  tests 1§ 
to  about  seven  hundred  and  fifty  freshmen.  Bell  definitely  states 
that  his  aim  was  to  devise  a  series  of  tests  that  would  "be  of  assis- 
tance to  college  authorities  in  aiding  freshmen  to  adjust  themselves 
to  their  environment."  The  time  required  for  testing  was  from 
forty  to  forty-five  minutes.  The  tests  were  given  not  individually, 
but  in  groups  averaging  a  little  less  than  twenty  each.  The  time- 
limit  method  was  used.  This,  together  with  his  arbitrary  method 
of  scoring  the  tests  may  account  in  some  measure  for  the  unsatis- 
factory nature  of  his  results.  He  weighted  each  test  so  that  a  perfect 

u  Waugh,  Dr.  Karl  T.  A  new  Mental  Diagnosis  of  the  College  Student.  New  York  Timet 
Magazine,  January  2,  19x6. 

n  Waugh's  tests  were:  x.  Concentration  of  attention  (cancellation  of  A's);  2.  Range  of  infor- 
mation; 3.  Speed  of  learning  (substitution);  4.  Quickness  of  association  (opposite*);  5.  Ingenuity 
(puzzle-box) ;  6.  Steadiness;  7*  Memory  for  a  passage  (immediately  after  hearing  it  read  and  after 
an  interval  of  two  weeks). 

u  Bingham.  W.  V.  Some  norms  of  Dartmouth  Freshmen;  Journ.  of  Educ.  Psychol.,  March, 
19x6,  Vol.  7.  PP-  1*0-142. 

M  Bingham's  tests  were:  x.  Endurance  of  grip;  2.  Tapping;  3.  Memory  span  for  auditory 
digits;  4.  Logical  memory;  5.  Cancellation;  6.  Color  Naming;  7*  Logical  relations;  8.  Mixed 
relations;  9.  Perception  of  form. 

»  Bell.  J.  Carleton.  Mental  Tests  and  College  Freshmen;  Journ.  of  Educ  Psychol.,  Sept.,  19x6, 
VoL  7.  pp.  38i-399. 

*•  Bell's  Tests  include:  x.  Cancellation  of  triangles;  2.  Addition;  3.  Association  or  learning 
pairs;  4.  Recognising  forms;  5.  Marking  right  statements;  6.  Easy  directions;  7.  Hard  Directions; 
t.  Alternatives;  9.  Completion  (using  "The  Strength  of  the  Eagle"  as  material). 
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mark  or  the  highest  mark  would  approximate  ioo,  and  the  other 
marks  range  downward  from  this  to  zero.  For  example,  in  the 
Triangles  test  there  were  fifty  triangles  to  be  crossed  out.  Each 
one  correctly  crossed  out  counted  two  points  and  five  points  were 
deducted  for  each  error,  positive  or  negative.  For  example,  if  a 
student  crossed  out  35  triangles,  omitted  3,  and  crossed  out  one 
circle,  his  score  was  70  minus  20  =  50.  The  other  tests  were  scored 
in  similar  manner. 

Bell  also  obtained  the  correlations  of  freshmen  university  grades 
with  each  other  and  of  the  university  grades  with  the  mental  tests. 
His  conclusions  are: 

1.  The  correlations  between  freshmen  university  grades  vary 
from  +  .34  (mathematics — history)  to  +  .59  (English — history, 
science — history) . 

2.  The  highest  correlation  between  class  marks  and  test  scores 
is  +  .31  (English — Completion). 

3.  Among  the  tests  themselves  the  highest  correlations  are  found 
between  the  Association  and  Recognition  tests,  and  between  the 
Directions,  Alternatives  and  Completion  tests. 

4.  There  is  a  considerable  difference  in  the  results  of  the  tests 
with  the  best  and  the  poorest  students,  but  the  scores  are  so  variable 
as  to  be  of  little  value  for  individual  diagnosis. 

The  investigations  of  Calfee,  Waugh,  Bingham,  and  Bell  illustrate 
the  striking  change  that  has  taken  place  in  the  character  of  mental 
tests  since  the  early  Columbia  tests  were  first  instituted.  In  place 
of  sensory  and  motor  tests  we  now  employ  tests  which  will  measure 
diverse  mental  functions.  Motivated  by  this  same  desire  to  secure 
a  group  of  tests  for  college  students  indicative  of  mental  ability, 
and  correlative  with  college  grades,  Rowland  and  Lowden lT  began 
to  try  out  groupings  of  psychological  tests  in  1912-13  and  carried 
out  their  investigations  over  a  period  of  three  years.  The  tests 
were  conducted  individually  on  all  the  students  in  Reed  College, 
twelve  students  of  experimental  psychology  assisting  in  conducting 
the  tests.  The  first  grouping  of  tests  was  tried  out  on  54  students 
during  1912-13,  after  which  the  grouping  was  revised  and  given  to 
195  more  subjects.  No  inter-test  correlations  are  reported.  The 
highest  correlation  between  university  grades  and  the  groupings 
was  between  the  grades  and  the  letter-group  g-r-s-t,  cancellation, 
opposites,  logical  memory,  judgment  (syllogism),  rote  memory, 

17  Rowland,  E.  and  Lowden,  G.    Report  of  Psychological  Tests  at  Reed  College-   Joura.  of 
Exper.  Psychol.,  1916,  I,  211-217. 
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cancellation  of  words  with  a  and  tt  (a  correlation  of  +  .37  with  a 
P.E.  of  ±  .06). 

Psychological  tests  have  also  been  conducted  for  several  years  at 
Vassar  College.  Results  of  tests  made  upon  Vassar  freshmen  during 
the  years  1914,18  1915,  and  1916 lf  show  data  collected  from  four 
sources,  namely:  1.  Answers  to  a  questionnaire  calling  for  infor- 
mation regarding  the  student's  imagery,  interests,  language  facility, 
and  habits;  2.  Results  of  the  tests;10  3.  Freshmen  academic  grades; 
4.  Reports  of  promising  students  by  their  instructors.  To  deter- 
mine roughly  the  correlation  between  academic  marks  and  test 
scores,  the  difference  between  the  average  class  standing  of  students 
having  test  scores  in  the  first  or  highest  quarter  and  the  average 
class  standing  of  students  with  test  scores  in  the  last  quarter  was 
found.  If  there  was  a  marked  difference  the  experimenters  con- 
cluded that  a  positive  correlation  existed.  According  to  this  rough 
method  they  found  a  positive  correlation  between  academic  marks 
and  the  tests  except  Hard  Directions.  On  the  whole,  the  results  of 
the  Vassar  tests  appeared  to  indicate  that  ability  in  the  tests 
correlates  well  with  ability  in  freshman  studies,  while  inability  to 
do  well  in  the  tests  is  correlated  with  a  similar  inability  to  do  well 
in  freshman  studies.  Moreover,  students  designated  as  "promising" 
by  their  instructors  tend  to  manifest  a  high  grade  of  performance 
in  the  tests.  (14.5%  of  317  freshmen  tested  in  1917  who  passed 
all  the  tests  in  the  Terman  Superior  Adult  Tests  were  rated  by  their 
instructors  as  being  of  only  average  ability.)  The  experimenters 
also  found  that  the  relation  between  success  in  freshman  tests  and 
academic  success  in  three  years'  work  is  less  than  that  between 
success  in  freshman  tests  and  academic  success  in  the  freshman 
year.  Inasmuch  as  there  were  thirty  different  testers,  each  one 
being  assigned  a  small  group  of  freshmen,  little  confidence  may  be 
placed  in  the  accuracy  of  the  data.  The  tests  as  conducted  at 
Vassar  are  of  value  more  for  the  opportunity  they  afford  students 
of  psychology  to  acquire  training  in  experimental  methods  of  pro- 
cedure than  for  any  contribution  they  make  to  our  knowledge  of 
freshman  standards  of  performance  in  various  tests. 

M  White,  Sophie  D.;  May,  Sybil;  and  Washburn,  M.  F.  A  study  of  Freshmen.  Minor  Studies 
from  the  Psychological  Laboratory  of  Vassar  College,  No.  31,  Amer.  Jour,  of  Psychol.,  1917.  Vol. 
a8,  pp.  I5I-I54- 

"  Montague,  M.;  Reynolds,  M.  M.;  and  Washburn,  M.  F.   A  Further  Study  of  Freshmen  . 
Amer.  Jour,  of  Psychol.,  1918,  29,  327-330. 

M  The  tests  described  include:  Verbal  memory  and  memory  for  ideas;  Reading  Backwards; 
Hard  Directions;  Analogies;  Sentence  Building;  Suggestibility;  Free  Association;  Thurstone 
Reasoning. 
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An  interesting  contribution  in  connection  with  the  application  of 
psychological  tests  to  college  freshmen  is  that  of  Kitson n  at  the 
University  of  Chicago.  With  the  general  purpose  of  devising  a 
"system  for  measuring  the  mental  capacity  of  college  students  in 
order  to  guide  their  college  work,"  Kitson  selected  sixteen  tests.* 
About  half  the  tests  were  given  by  the  group  method.  The  time 
required  for  testing  was  two  and  one  half  hours.  From  forty  com- 
plete records  Kitson  computed  norms  of  performance  in  the  various 
tests.  In  addition,  a  graphic  chart  was  arranged  for  each  student 
to  show  his  standing  in  each  test  and  to  furnish  a  net  score  com- 
bining his  standing  in  all  the  tests.  In  the  particular  tests  used, 
Kitson   found   a   significant   positive   correlation   only  between: 

1.  Memory   for  meaningful   material   seen   and   heard    (+.54); 

2.  Between  the  first  and  second  reproductions  of  this  material 
(+  49);  3.  Between  the  Opposites  and  Constant  Increment  tests 
(+  .40).  When  correlations  were  computed  of  standings  in  each 
test  with  standings  in  the  net  score,  they  were  found  to  be  some- 
what higher.  The  correlation  between  college  marks  and  psychologi- 
cal tests  was  found  to  be  +  .44  (P.E.  .09)  but  from  forty  records 
secured  from  a  second  group  of  freshmen  tested  the  correlation  was 
found  to  be  only  +  .20  (P.E.  .11).  Kitson  explains  this  low  correla- 
tion on  the  ground  that  many  other  factors  besides  intelligence  enter 
in  to  determine  standing  in  school  studies,  such  as  the  personal 
factor  of  the  instructor,  the  student's  will  power,  social  surroundings, 
economic  conditions,  and  physical  condition.  The  correlation 
between  the  psychological  tests  and  intelligence  as  estimated  by 
the  dean  was  +  .57  (P.E.  .05).  Twenty-one  of  the  1915  freshmen 
were  retested  in  seven  of  the  tests  in  their  Sophomore  year  and 
improvement  was  shown  in  every  test  except  one.  (Numbers  heard.) 
Comparison  between  the  net  score  for  freshman  and  sophomore 
year  shows  a  correlation  of  +  .88  (P.E.  .03). 

Although  his  norms  of  performance  in  the  tests  and  his  inter- 
test  correlations  are  not  very  reliable,  based  as  they  are  upon  only 
forty  records,  there  is  much  to  be  said  in  favor  of  Kitson's  general 
method  of  procedure.  His  emphasis  upon  the  importance  of  study- 
ing the  individual  student  in  his  relation  to  the  college  and  his 

*  Kitson.  H.  D.  The  Scientific  Study  of  the  College  Student.  Psychol.  Monog..  1917. *3  (No.  08). 
p.  81. 

a  The  tests  employed  were:  Number-checking;  Memory  for  numbers  heard;  Memory  for  objects 
seen;  Memory  for  logical  material  heard;  Secondary  memory  for  same;  Immediate  memory  for 
logical  material,  seen;  Secondary  memory  for  same;  Loss  in  logical  material,  heard;  Loss  in  logical 
material,  seen;  Opposites;  Constant  increment;  Hard  directions,  printed  and  oral;  Word  bond- 
ing; Sentence-building;  and  Business  ingenuity. 
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realization  of  the  fact  that  psychological  measurements,  however 
large  the  role  they  may  play  in  determining  a  student's  abilities 
and  aptitudes,  must  not  be  considered  the  sole  factor  in  such  a 
determination,  but  rather  should  be  so  coordinated  with  measures 
of  the  student  from  various  other  aspects  as  to  lead  to  our  fuller 
understanding  of  the  nature  of  the  individual  student  and  his 
potentialities,  signify  a  decided  advance  in  the  method  of  treating 
the  problem.  The  splendid  cooperation  of  all  the  students  and 
his  success  in  dealing  with  delinquent  cases  speak  much  for  Kitson's 
general  method. 

Other  minor  investigations  have  been  made  on  freshmen  with  the 
same  purpose.  Sunne,**  working  at  Newcomb  College,  found  a 
low  correlation  between  college  grades  and  an  information  test 
tried  on  twenty-five  freshmen,  and  with  ninety-nine  freshmen  who 
were  given  a  series  of  tests  found  correlations  of  tests  with  grades 
ranging  from  o  to  +  .25.  Haggerty  *  found  a  correlation  of  a 
quality  of  reading  test  and  omnibus  test  with  medical  marks  of 
+  .62  and  +  .60,  respectively,  and  of  the  two  combined  of  +  .65, 
in  the  case  of  sixty-nine  candidates  for  medical  school  who  had 
already  completed  two  years  of  college. 

At  the  University  of  Iowa  King*  working  with  a  little  group  of 
nineteen  freshmen,  found  a  tendency  for  the  students  with  high 
academic  marks  to  make  higher  scores  in  the  completion,  logical 
memory,  and  lanes  test  than  the  students  with  low  academic  marks. 
He  gives  no  statistical  evidence  in  support  of  this  statement.  Later, 
using  a  series  of  five  tests  with  56  freshman  engineers,  he  obtained 
a  correlation  between  students'  ranks  in  all  the  tests  combined  and 
their  academic  grades  of  +  .27.  The  tests  employed  by  King  were: 

1.  Courtis  Arithmetic,  Series  B,  (graded  for  speed  and  accuracy); 

2.  Hard  Opposites;  3.  Recognition  of  Forms;  4.  The  Kansas  Silent 
Reading  Test,  (H.S.  Series) ;  and  5.  "Hall  Cube  Test,"  a  test  of 
visual  imagination. 

A  little  later  Irving  King  and  James  M'Crory  *  followed  Kitson's 
method  more  definitely.  In  the  fall  of  1916  they  tested  276  women 
and  268  men  freshmen  in  seven  different  tests:  the  Courtis  Standard 

•Sunne.  D.  The  Relation  of  .Clan  Standing  to  College  Tests.  Journ.  of  Educ.  Psychol.,  1917, 
8,  193-31 1. 

*  Haggerty.  M.  B.  Tests  of  Applicants  for  Admission  to  University  of  Minnesota  Medical 
School.  Journ.  of  Educ  Psychol.,  1918*  9.  278-286. 

*  King.  I.  The  relationship  of  abilities  in  certain  mental  tests  to  ability  as  estimated  by  teachers. 
School  fe  Society,  1917.  5*  204-209. 

*  King.  I.  and  M'Crory,  J.  Freshman  Tests  at  the  University  of  Iowa,  Journ.  of  Educ.  Psychol., 
1918,  9.  32-46. 
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Arithmetic  Test,  Series  B;  mixed  relations;  two  tests  of  "opposites;" 
a  completion  test  used  by  Simpson;  visualization;  Whipple's  infor- 
mation test,  and  a  logical  memory  test.  The  group  method  of  test* 
ing  was  used,  the  tests  being  given  in  groups  of  from  ten  to  twenty- 
five.  Their  rather  low  inter-test  correlations  indicate,  they  state, 
that  they  are  measuring  a  variety  of  mental  functions.  They  find, 
moreover,  fairly  good  correlations  between  the  tests  and  academic 
grades  (+  .14  to  +  .45  in  the  case  of  the  girls,  and  +  .21  to  +  .84 
in  the  case  of  the  boys).  In  their  attempt  to  make  practical  applica- 
tion of  the  tests  for  the  diagnosis  of  their  students  in  general  and 
cases  of  special  ability  and  disability,  as  Kitson  does,  they  have 
been  fairly  successful. 

At  Northwestern  University  Uhl*7  obtained  inter-test  correla- 
tions ranging  from  +  .18  (Trabue  Completion  K  and  Information), 
to  +  .42  (Trabue  Completion  M  and  Information),  for  a  group  of 
one  hundred  freshmen  tested  in  the  fall  of  1916.  His  series  contained 
Only  four  tests:  Trabue  Completion  K  and  M,  a  hard  opposites  list 
of  twenty  words,  and  an  information  test  which  consisted  of  the 
seventy  most  familiar  words  in  Whipple's  list  plus  thirty  new  words. 
Test  correlations  with  the  first  semester  English  and  Mathematics 
grades  were  determined  and  found  to  range  from  +  .48  (English  and 
Mathematics),  to  +  .16  (Completion  K  and  Mathematics).  When 
he  had  three  mathematics  instructors  rate  these  one  hundred  stu- 
dents for  ability,  Uhl  found  a  correlation  of  +  .93  between  their 
ratings  and  the  Mathematics  grades  of  the  students.  This  high 
correlation  was  no  doubt  due  to  the  tendency  on  the  part  of  the 
teachers  to  make  their  judgments  of  the  students  practically  equiva- 
lent to  the  students'  course  grades.  The  correlation  between  the 
instructor's  judgments  and  the  ranks  of  these  same  students  in  their 
last  year  of  high  school  was  +  -59*  and  with  all  the  tests  combined 
was  +  .36.  Uhl  thinks  his  tests  fail  to  measure  accurately,  the 
information  test  being  the  most  unsatisfactory,  and  attributes  his 
low  correlations  to  the  homogeneity  of  his  group,  the  relative  sim- 
plicity of  the  tests,  and  the  unreliability  of  school  marks. 

Thurstone's 28  work  represents  a  further  development  in  the  use 
of  psychological  tests.  At  the  Carnegie  Institute  of  Technology  the 
attempt  is  made  to  use  psychological  tests  as  a  criterion  for  admis- 
sion. A  series  of  six  mental  tests  was  given  to  114  freshmen  of  the 
Margaret  Morrison  Carnegie  School  in  October,  1917.  The  problem 

"  Uhl,  W.  L.  Mentality  Tests  for  College  Freshmen,  Joura.  of  Bdac  Psychol.,  1919, 10,  13-aS 
"  Thurstone.  L.  L.  Journ  of  Educ.  Psychol.,  Match,  1919. 
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was  to  determine  whether  they  could  reduce  the  number  of  students 
who  were  dropped  for  poor  scholarship  or  placed  on  probation  for 
poor  scholarship  by  the  use  of  the  mental  tests,  and  to  determine 
whether  the  mental  test  ratings  correlated  with  faculty  estimates 
concerning  the  general  ability  of  the  students.  The  tests  which 
agreed  well  with  the  judgment  of  the  faculty  were  retained.  In 
working  up  his  results  Thurstone  used  the  method  of  critical  scores. 
After  plotting  scatter  diagrams  for  each  test,  upper  and  lower  critical 
scores  were  determined  such  that  every  student  above  the  upper 
critical  score  is  above  the  average  in  the  opinion  of  the  faculty, 
and  every  student  below  the  lower  critical  score  is  below  the  average 
in  the  opinion  of  the  faculty.  The  mental  test  rating  was  designated 
as  the  medium  percentile  rank  in  all  six  tests  plus  5  points  for  each 
test  in  which  the  student  is  above  the  upper  critical  score,  and 
minus  5  points  for  each  test  in  which  he  is  below  the  lower  critical 
score.  Students  with  a  mental  test  rating  of  —  10  or  below  were 
reported  as  doubtful. 

Thurstone  found  a  correlation  between  instructors'  estimates  of 
students'  ability  and  the  combined  mental  test  rating  of  +  .60. 
From  his  results  he  concluded  that:  1.  The  mental  test  rating 
would  have  eliminated  seven  of  the  eleven  total  failures  at  the 
beginning  of  the  year.  2.  No  average  or  good  student  would  have 
been  eliminated  by  the  mental  test  rating.  All  students  who  scored 
below  the  lower  critical  mental  test  rating  were,  without  exception, 
poor  students. 

Moreover,  all  the  freshmen  who  were  rated  high  by  the  faculty 
were  above  the  average  in  the  mental  test  rating.  From  all  indica- 
tions, this  method  is  working  out  well  at  Carnegie. 

The  past  three  years  have  brought  a  further  development  in  the 
use  of  psychological  tests  for  measuring  the  intelligence  of  college 
freshmen.  Since  1918  the  Army  Alpha  test  has  been  administered 
to  freshmen  in  several  colleges  with  varying  degrees  of  success. 
Professor  Stone  M  reports  that  its  use  at  Dartmouth  justifies  the 
recent  proposal  to  admit  students  scholastically  in  the  upper  quarter 
of  their  class  in  approved  schools.  Strictly  speaking,  the  work  at 
Dartmouth  should  not  be  included  in  this  history,  since  it  deals 
with  the  results  obtained  in  testing  all  the  college  classes  rather 
than  freshmen  only.  We  mention  it  here,  however,  because  the 
college  authorities  are  now  devoting  particular  attention  to  admin- 

•  Stone,  Charles  Leonard.  "Intelligence  and  Scholarship;0  The  Dartmouth  Alumni  Magazine 
March,  ioao. 
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istering  the  test  to  the  freshman  class.  During  the  fall  of  1918  the 
Army  Alpha  test  was  given  to  all  the  students  in  the  Students  Army 
Training  Corps  which  included  practically  the  entire  student  body. 
The  average  score  in  Alpha  for  the  677  S.  A.  T.  C.  men  tested  was 
147.5.  The  average  academic  grade  for  the  same  men  was  2.12, 
using  the  scale  D  «  1,  C  =  2,  B  =  3,  A  =  4.  The  correlation 
between  the  academic  marks  and  Alpha  scores  was  +  .44.  There  is 
also  a  significant  correspondence  between  a  student's  score  in  the 
Alpha  test  and  the  scholarship  quintile  his  academic  record  places 
him  in.  Although  less  exact  than  Thurstone's  method  of  assigning 
individuals  their  relative  position  in  a  group,  this  method  serves  to 
give  a  rough  and  quick  estimate  of  a  student's  status. 

Similar  to  this  Dartmouth  study  is  that  of  Walcott's  *•  at  Hamline 
University.  Here,  too,  not  freshmen  alone,  but  all  students  were 
given  the  Alpha  test  in  the  fall  of  1918.  Walcott's  results  are  based 
on  data  secured  from  61  men  and  145  women.  As  in  the  Dartmouth 
investigation,  a  far  greater  proportion  of  men  and  women  students 
secure  a  score  in  Alpha  in  the  high  grade  intelligence  group  than 
was  found  in  any  of  the  army  camps.  The  median  score  is  129  for 
the  Hamline  men  and  133  for  the  women,  with  the  same  sharp 
differentiation  between  the  poor  and  the  good  groups  as  Stone  found 
at  Dartmouth.  The  correlation  between  the  results  of  the  Alpha 
test  for  the  women  and  their  first  term  academic  grades  was  +  .47, 
slightly  higher  than  the  Dartmouth  result.  Although  Waloott  does 
not  consider  the  army  test  the  best  device  for  determining  the  fitness 
of  students  for  college  work,  he  sees  in  the  significant  difference  in 
score  between  the  upper  and  lower  half  of  the  students  tested,  the 
practical  use  to  be  made  of  this  fact  in  the  placing  of  students. 

Similar  investigations  have  also  been  conducted  by  Hill,  Filler,11 
and  Hunter  at  the  University  of  Illinois,  Dickinson  College,  and 
Southern  Methodist  University,  respectively.  At  the  University 
of  Illinois  3,500  students  were  tested  in  twenty-four  groups  in 
March,  1919,*  members  of  the  faculty  acting  as  experimenters. 
As  at  Dartmouth  and  Hamline,  the  scores  of  the  students  at  each 
of  these  colleges  show  them  to  be  a  very  select  group  compared  to 
the  army  men.  The  median  score  of  the  freshmen  in  the  school  of 
liberal  arts  and  sciences  at  the  University  of  Illinois  is  147.    At 

**  Wakoti  G.  D.  'Mental  T*9Cin<  at  Hanhne  rnivmtjr.*  School  and  Society.  1919.  to.  57-60. 

*  FSDer.  XI.  G.   A  PK>\*x4c*»ca]  TV*t,  sfefexil  *  Sixaety.  iota.  10,  aot-wo. 

*  HOL  D.  S.  Remit*  of  ImeQifetfec*  TVs:*  »t  the  TaitmitT  of  Ilhaott;  School  ft  Society.  1010, 
O.  JUJ-545. 
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Southern  Methodist  University1*  the  effort  was  made  to  secure 
select  groups  of  students  in  order  to  compare  their  scores  with  the 
average  score  for  the  school.  Each  student  was  asked  to  name  men 
and  women  students  whom  they  thought  would  make  high  scores 
in  the  Alpha  test.  For  16  meq  and  8  women  named  by  from  five  to 
forty  students  as  being  able  to  make  the  highest  scores,  the  average 
score  for  the  men  was  154,  and  for  the  women  156,  justifying  the 
judgment  of  the  students.  With  a  similar  group  of  students  named 
by  the  faculty  as  being  able  to  make  the  highest  scores  even  better 
results  were  obtained,  the  average  for  the  men  being  161  and  for 
the  women  167.  In  selecting  a  group  of  men  and  women  whom  they 
judged  would  make  low  scores  the  faculty  were  equally  successful. 
Both  faculty  and  students  thus  showed  themselves  fairly  good  in 
their  ability  to  select  students  on  the  basis  of  intelligence,  though 
this  method  of  selection  is  inferior  to  selection  on  the  basis  of  actual 
scores.  The  correlation  between  the  Alpha  scores  of  the  women 
students  and  their  college  grades  for  the  fall  term  was  +  -52.  No 
correlations  are  given  in  the  Illinois  and  Dickinson  reports,  which 
are  only  preliminary. 

The  following  is  a  comparative  table  showing  scores  obtained 
at  the  University  of  Illinois,  Dickinson  College,  and  Southern 
Methodist  University: 

Southern 
University        Dickinson  Methodist 

of  Illinois  College  University 

Total  number  tested 3,254  213  321 

Number  of  freshmen 489  72  128 

Lowest  freshman  score 52  75  60 

Highest  freshman  score 188  195  188 

Median  freshman  score 147  141  127 

Hunter  explains  the  lower  median  score  at  Southern  Methodist 
University  as  due  to  a  difference  in  the  method  of  conducting  the 
test. 

More  fully  developed  than  these  three  preliminary  investigations 
is  the  work  being  done  at  Brown  University.*4  Colvin  reports  the 
results  obtained  from  103  freshmen  with  the  Alpha  test  and  two 
series  of  psychological  tests,  known  as  Brown  University  Series  I 
and  II,  which  were  separated  by  an  interval  of  several  days.  Each 
series  consisted  of  four  tests:  mutilated  sentences,  vocabulary, 
analogies  or  mixed  relations,  and  a  reasoning  test.  The  distribution 

"Hunter,  H.  T.  Intelligence  Tests  at  Southern  Methodist  University;  School  &  Society, 
xoio,  10.  437-440. 

"  Colvin,  S.  S.  Psychological  Tests  at  Brown  University;  School  &  Society,  1919,  10,  27-30. 
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of  scores  for  both  Series  I  and  Series  II  separately  and  for  die 
combined  scores  of  Series  I  and  II  conformed  closely  to  a  normal 
probability  curve.  The  correlation  between  Brown  University 
Series  I  and  II  is  +  .75,  and  between  the  average  of  these  two  series 
and  the  Alpha  test  is  +  .79.  The  correlation  between  the  Brown 
University  tests  and  the  average  academic  marks  of  the  first  and 
second  terms  is  +  .59,  and  between  the  army  test  and  the  average 
of  the  maiks  of  the  first  and  second  terms  is  +  .45.  Practical  appli- 
cation waa  made  of  the  tests  to  foretell  a  student's  probable  aca- 
demic agfyess  and  to  aid  in  diagnosing  cases  of  failure  in  school 
work.  Of^ym  found  that  two-thirds  of  80  students  reported  as 
doing  unKtisfactory  work  in  the  first  term  had  made  low  scores  in 
their  psychological  tests,  while  only  one-sixth  of  the  men  had  a 
satisfactory  grade.  Most  of  the  cases  of  students  doing  poor  college 
work  who  had  obtained  high  scores  in  the  tests  were  due  not  to 
lack  of  ability,  but  to  other  reasons.  So  satisfactory  have  the  tests 
been  in  determining  the  students'  mental  status  and  helping  them 
that  they  are  still  being  employed. 

In  a  recent  article  in  the  Educational  Review19  Professor  Colvin 
compares  in  greater  detail  the  scores  and  correlations  obtained  in 
the  Brown  University  tests  and  the  Alpha  test,  and  reports  results 
secured  in  giving  the  Brown  tests  and  the  Thorndike  tests  to  300 
freshmen.  The  Brown  tests  require  about  fifty-five  minutes  of 
actual  working  time  as  contrasted  with  about  three  hours  required 
by  the  Thorndike  tests.  The  median  score  for  the  Brown  tests  is 
62.4  with  a  standard  donation  of  10.59,  compared  to  the  median 
score  for  the  Thorndike  tests  of  76.5  with  a  standard  deviation  of 
14.89,  the  difference  being  due  to  the  fact  that  the  Brown  tests 
have  a  maximum  score  of  100,  while  the  Thorndike  tests  have  a 
maximum  score  of  about  150.  The  correlation  between  the  scores 
obtained  by  students  in  the  two  tests  is  +  .816  with  a  P.E.  of  .0138, 
but  the  Thorndike  tests  show  a  higher  correlation  with  academic 
marks  (+  .53)  than  the  Brown  tests  (  +  .46).  While  the  Thorndike 
tests  show  a  slight  superiority  in  prognostic  value,  nevertheless* 
results  show  that  men  receiving  scores  in  the  lowest  fifteen  per- 
centile of  either  the  Brown  or  the  Thorndike  tests  have  a  relatively 
small  chance  of  graduating  from  college.  Colvin  warns  against  the 
danger  of  refusing  men  admission  to  college  solely  because  of  a  low 
psychological  record.    He  advocates  the  conservative  position  of 

*  Colvin.  S»  S.  The  Validity  of  INyvholocKal  Te*t*  J  or  Colfe«c  Entrance.    Educational  Review. 
June.  1930. 
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regarding  the  psychological  record  as  one  among  many  factors  to 
be  considered  in  diagnosing  cases  of  individual  students. 

At  Ohio  State  University  the  Alpha  test  was  successfully  given 
to  5,950  students  October  10,  1919,  in  groups  of  one  hundred  to 
two  hundred  and  fifty.  The  distribution  of  scores  for  the  entire 
group  conformed  to  the  normal  probability  curve,  the  students 
being  grouped  into  five  classes  as  follows: 

Approximate 
ClMi     Soon  Percentage  in  Bach  Claw 

I.   178-212    Very  superior  intelligence 5 

II.   155-177    Superior  *  20 

III.  Ii5~i54    Average  "  50 

IV.  85-114    Fair  *  20 

V.       0-84    Poor  ■  5 

The  percentage  of  students  falling  into  each  of  these  five  classes 
was  then  determined  for  the  various  university  units  separately, 
such  as  the  Graduate  School,  Commerce  and  Journalism,  Law, 
Medicine,  Engineering,  Arts — Education,  Agriculture,  Pharmacy, 
etc.  The  median,  highest,  and  lowest  scores,  and  the  number 
examined  for  each  class  (college  year),  in  each  college  and  in  the 
whole  university,  are  reported.  The  highest  median  score,  157, 
was  obtained  by  the  Graduate  School;  Arts  received  second  place 
with  a  median  score  of  147;  Commerce  and  Journalism  third,  with 
a  median  score  of  146;  and  so  on  down  to  a  median  of  112,  (Veterin- 
ary Medicine  group).  The  report  gives  an  interesting  comparison 
of  the  various  college  groups. 

The  Thorndike  tests,  previously  mentioned,  are  rapidly  becoming 
more  widely  employed  for  freshmen  testing  than  the  Army  Alpha. 
Jones,"  writing  in  the  Educational  Review,  clearly  describes  the 
general  nature  of  these  tests.  Although  conceding  their  practical 
value,  he  urges  that  they  should  be  employed  "not  to  the  exclusion 
of  other  measures  for  determining  fitness,  but  along  with  them.19 
Evidence  of  a  student's  fitness  to  undertake  college  work  should,  in 
Professor  Jones'  opinion,  include  his  preparation  for  college  work, 
his  character  and  promise,  his  health,  and  his  intelligence  denoted 
by  his  score  in  the  Thorndike  test.  In  a  brief  report  before  the 
New  York  Branch  of  the  American  Psychological  Association  this 
year  Mr.  Wood  stated  .that  the  purpose  of  the  Thorndike  tests 
was  fourfold:  1.  To  select  those  fit  for  a  college  course;  2.  To  aid 
college  committees;  3.  To  assist  the  progress  of  schools;  4.  To 

MJaacs,  A.  L.  Psychological  Tests  for  College  Admission;  Educational  Review,  1919*  5*. 
271-378. 
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assist  the  Dean  in  the  administration  of  the  college.  Results  fron 
a  large  number  of  freshmen  showed  a  correlation  between  the  tota 
Thomdike  score  and  the  average  college  grade  of  +  .52,  and  tb 
median  college  grade  of  +  .54.  Although  no  published  reports  0 
results  secured  with  the  Thomdike  tests  have  appeared,  invest 
gators  who  are  employing  the  tests  find  them  highly  satisfactory. 


SECTION  II 


STATEMENT  OF  THE  PROBLEM  WITH  A  LIST 
OF  THE  TESTS  EMPLOYED 

The  present  investigation,  begun  at  Barnard  College  in  the  fall 
of  1915,  about  two  years  before  die  Army  Alpha  and  the  Thorndike 
Tests  were  originated,  was  carried  on  during  the  years  1915-16, 
1916-17,  the  fall  of  1917,  and  the  spring  of  1919.  The  general 
purpose  underlying  the  investigation  was  similar  to  that  underlying 
the  investigations  of  other  experimenters  during  this  period — a 
purpose  which  continues  to  motivate  present  studies.  The  aim  was 
first,  to  establish  norms  and  standards  of  performance  in  mental 
tests  for  Barnard  freshmen,  and  second,  to  give  students  a  clear 
conception  of  their  abilities  and  aptitudes  along  various  lines. 
More  specifically,  this  investigation  concerns  the  trial  of  a  group 
of  tests  with  the  object  first,  of  determining  their  reliability  as 
measures;  second,  their  correlation  with  freshman  university  grades; 
and  third,  with  physical  records  taken  in  the  gymnasium. 

In  selecting  the  particular  group  of  tests  to  be  used  several  factors 
contributed.  Paramount  in  importance  was  the  desire  to  select 
a  series  of  tests  of  such  nature  as  to  call  into  play  various  mental 
functions.  In  addition,  it  was  desired  to  secure  tests  which  previous 
investigators  had  found  to  have  a  positive  correlation  with  such 
factors  as  age,  ability  along  some  vocational  line,  or  general  intelli- 
gence. Equally  important  in  determining  the  final  selection  was  the 
time-limitation  factor.  Owing  to  unwillingness  on  the  part  of  stu- 
dents to  act  as  subjects  for  a  longer  period,  and  to  the  factor  of 
fatigue  which  would  probably  influence  the  results  of  tests  com- 
pleted after  that  time,  it  was  found  necessary  to  have  a  series  of 
tests  such  as  could  be  completed  in  one  hour.  Consideration  of  all 
these  factors  finally  lead  to  this  selection  of  tests: 


1.  Coordination 

2.  Tapping 

3.  Cancellation 

4.  Checking 

5.  Color  Naming 

6.  Directions 

7.  Opposites 


8.  Verb-object 

9.  Mixed  Relations 

10.  Word  Building 

11.  Word  Naming 

12.  Knox  Cube 

13.  Digit  Span 


14.  Word  Memory 

15.  Logical  Memory 

16.  Substitution 

17.  Completion 

18.  Information 

19.  Vocabulary 


SECTION  III 

METHOD  AND  TECHNIQUE  OF  THE  INVESTIGATION 

Shortly  after  the  beginning  of  the  academic  year,  in  the  fall  of 
1915,  the  series  of  tests  selected  according  to  the  manner  described 
in  the  preceding  section  was  submitted  to  a  preliminary  trial  in 
order  to  determine  the  best  method  of  conducting  the  tests,  and  to 
afford  the  writer  practice  in  their  administration.  After  determining 
the  general  method  of  procedure,  a  notice  was  posted  in  the  Fresh- 
man Study  of  Barnard,  stating  that  a  series  of  psychological  exam- 
inations had  been  instituted  for  Barnard  freshmen,  and  giving  a 
description  of  the  nature  and  purpose  of  the  tests.  It  was  stated 
that  the  time  required  for  the  examination  was  one  hour,  and  an 
accompanying  schedule  indicated  the  hours  at  which  the  test 
might  be  taken.  The  place  where  the  examinations  were  to  be 
held  was  also  indicated,  and  all  freshmen  interested  were  requested 
to  sign  their  names  on  the  schedule  opposite  the  hour  at  which 
they  could  take  the  test.  This  method  of  permitting  the  student 
to  take  the  test  at  the  hour  most  convenient  for  her,  rather  than  at 
a  time  prescribed  by  the  experimenter,  seems  advisable  in  that  it 
establishes  a  certain  uniformity  in  conditions,  the  student  usually 
being  in  her  best  physical  condition  at  the  time  of  testing.  In  addi- 
tion, letters  were  sent  to  individual  students  in  the  class,  reminding 
them  of  the  examination,  and  an  account,  written  by  Professor 
Hollingworth,  of  the  widespread  use  of  similar  tests  by  reliable 
business  firms  and  their  value  in  selecting  candidates  for  positions 
along  various  lines,  appeared  in  the  college  weekly.  A  similar  notice 
of  the  tests  was  posted  in  Freshman  Study  in  the  fall  of  1916,  and  in 
the  fall  of  IQI7.  Letters  were  also  sent  to  individual  students  at 
these  times. 

The  subjects,  as  indicated,  were  Barnard  students  in  their  fresh- 
man year.  The  fact  that  they  had  had  no  training  in  experimental 
psychology,  and  were  unfamiliar  with  the  tests  employed,  made 
them  a  suitable  group  for  testing.  Out  of  a  class  of  about  one 
hundred  and  forty  freshmen  during  1015-16.  one  hundred  were 
tested.  This  constitutes  our  first  gTOup  of  subjects  whom  we  will 
designate  as  Oroup  I.    Puring  the  year  1016-17  (.class  of  1920), 
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eighty-five  freshmen  were  tested,  and  in  the  fall  of  1917  fifteen  more 
(class  of  1 921)  were  given  the  tests.  These  last  two  groups  together 
constitute  our  second  group  of  one  hundred  freshmen  whom  we  will 
designate  Group  II.  In  addition,  in  order  to  determine  the  reliability 
of  the  tests,  the  series  was  divided  into  two  equivalent  parts  in  a 
manner  to  be  described  later.  In  the  spring  of  1919,  during  the 
period  extending  from  March  14  to  May  15,  forty-five  freshmen 
from  the  class  of  1922  were  tested  twice  on  the  same  day,  each  test 
requiring  forty-five  minutes  of  the  student's  time. 

All  the  tests  were  given  individually.  This  enabled  the  experi- 
menter to  supervise  personally  the  performance  of  each  subject  and 
to  stop  her  at  any  indication  that  she  did  not  fully  understand  the 
directions  given.  It  was  likewise  an  important  factor  in  contributing 
to  the  standardization  of  the  conditions  of  the  experiment.  The 
subject  was  by  this  means  freed  from  any  feelings  of  irritation  or 
discouragement  that  might  have  arisen  if  she  had  taken  the  test 
with  a  group  of  students  whom  she  knew  to  be  more  rapid  workers 
than  herself.  In  such  a  case  the  knowledge  that  others  were  accom- 
plishing their  work  in  a  shorter  period  of  time  would  operate  to 
arouse  in  some  subjects  such  feelings  of  the  futility  of  competing  with 
their  companions  that  their  resulting  performance  would  have  been 
much  slower  than  would  have  been  the  case  where  the  tests  were 
taken  under  more  favorable  conditions.  Each  freshman,  then,  was 
examined  individually,  and  every  effort  was  exercised  to  make  the 
conditions  of  the  experiment  as  uniform  as  possible.  The  room 
employed  for  the  testing  was  one  regularly  used  by  the  Department 
of  Psychology  for  advanced  experimental  work,  and  from  the  point 
of  view  of  light  and  ventilation  it  is  well  adapted  for  research. 
Except  during  the  tapping  and  coordination  tests,  the  subject  sat 
at  a  small  laboratory  table,  opposite  the  experimenter.  As  the  room 
was  so  situated  as  to  be  almost  unaffected  by  sounds  from  neighbor- 
ing rooms,  and  was  itself  kept  in  a  quiet  condition,  there  was  nothing 
to  distract  the  subject's  attention  from  her  work. 

As  previously  indicated,  attempt  to  secure  uniformity  in  admin- 
istering the  tests  was  also  made.  Besides  giving  the  tests  individ- 
ually, the  order  in  which  the  tests  are  listed  was  followed.  In  a  few 
cases  circumstances  rendered  it  necessary  to  deviate  slightly  from 
this  order,  but  in  general  it  was  followed  rigidly.  The  result  of  the 
preliminary  trial  had  been  to  indicate  the  most  satisfactory  manner 
in  which  the  tests  should  be  administered.  The  aim  was  to  make 
the  directions  as  clear,  simple,  and  direct  as  possible.  As  a  detailed 
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account  of  the  instructions  given  for  each  test  will  be  considered  in 
the  next  section,  it  is  only  necessary  to  mention  here  that  the  method 
of  procedure  agreed  upon  was  carefully  followed  with  one  or  two 
exceptions  where  misinterpretation  of  the  directions  resulted  in  the 
experimenter's  repeating  the  instructions  in  a  slightly  different  form. 


SECTION  IV 

DISCUSSION  OF  THE  TESTS,  INCLUDING  MATERIALS 
USED,  METHODS  OF  PROCEDURE,  AND  RESULTS 

Test  No.  I.     Coordination 

This  test,  popularly  termed  the  "three-hole  test"  calls  for  both 
speed  and  accuracy  of  movement  and  gives  an  indication  of  the 
subject's  motor  ability  and  coordination. 

Apparatus:  An  oak  plate  tilted  at  an  angle  of  45  degrees  to  the 
base  board,  containing  three  brass-line  holes  arranged  in  the  form 
of  an  equilateral  triangle,  about  8  cm.  apart.  Contact  of  the  metal 
rod  with  the  bottom  of  the  hole  makes  an  electrical  connection 
recorded  by  the  automatic  counter.  Stop  watch. 

Instructions:  aI  want  you  to  hold  this  (stylus)  in  your  right  hand 
and  to  touch  the  bottom  of  each  one  of  these  targets  as  quickly  as 
possible,  going  around  in  a  circle  without  skipping  any  of  the  holes. 
You  see  every  time  you  do  so,  the  contact  is  registered  on  the 
electric  counter.  I  want  to  see  how  many  contacts  you  can  make 
in  one  minute.  You  start  then  when  I  say,  'Go*  and  stop  when  I 
say,  'Stop.'" 

Method  of  scoring:  The  score  represents  the  number  of  contacts 
made  in  one  minute. 

Results:  The  average,  standard  deviation,  and  range  for  groups 
I  and  II  (200  freshmen  in  all),  is  indicated  in  Table  I  below: 


Test  No.  z 
Coordination 

Group  I 
Group  II 


TABLE  I 

Average 

S.  D. 

Rangt 
Poorest 
(Av.  of 
lowest  s) 

r 
Best 
(At.  of 
bests) 

82.7 
84.I 

IO.77 
II.92 

63.8 
60.8 

IO9.O 
1 104 

Test  No.  2.     Tapping 

This  test  has  been  widely  used  as  a  test  of  motor  speed  and  endur- 
ance and  has  been  considered  by  some  experimenters  to  afford  the 
best  index  of  motor  capacity. 

Apparatus:  Tapping  board  with  metal  plate  and  electric  counter. 
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Tapping  stylus  with  flexible  connecting  wire  attached.  Two  dry 
cells.  Stop  watch. 

Instructions:  aI  want  you  to  hold  this  (stylus)  in  your  right  hand 
and  tap  on  here  (indicating  the  brass  plate)  as  quickly  as  possible. 
I  want  to  see  how  many  times  you  can  tap  in  a  minute.  Start  when 
I  say  'Go*  and  stop  when  I  say  'Stop.' "  These  instructions  were 
accompanied  by  an  illustration  of  tapping  by  the  experimenter. 
For  this  test  the  subject  sat  directly  in  front  of  the  tapping  board, 
resting  her  arm  on  the  table,  and  assumed  the  position  most  con- 
venient for  her. 

Method  of  scoring:  The  score  represents  the  number  of  taps 
made  in  one  minute. 

Results:  Table  II  shows  the  results  obtained  in  this  test: 


Test  No.  a 
Tapping 

Group  I 
Group  II 


TABLE  II 

Average 

S.D. 

Rmmge 
Poorest                Best 
(Av.  of              (At.  of 
lowest  5)           best  5) 

376.26 
368.54 

5169 
39-32 

263.2              499.O 
2830              4514 

Test  No.  j.     Cancellation 

This  test  is  well  adapted  for  measuring  concentration  and  alert- 
ness of  attention,  maximum  effort  being  required  to  accomplish 
the  task  quickly  and  accurately.  In  addition  to  involving  such 
factors  as  "speed  of  perception"  and  "discrimination"  it  is  partly 
dependent  upon  the  subject's  muscular  reaction  to  stimuli  presented. 
Owing  to  the  fact,  previously  mentioned,  that  it  was  necessary  to 
complete  all  the  tests  in  one  hour,  it  was  found  advisable  to  limit 
some  of  the  tests.  Inasmuch  as  we  desired  to  include  the  Checking 
Test  which  involves  functions  similar  to  those  involved  in  Cancella- 
tion and  as  it  was  believed  that  these  two  tests  together  would 
exert  an  unfavorable  influence  upon  the  results  of  following  tests 
due  to  the  eye-strain  they  would  cause,  it  was  deemed  advisable  to 
use  only  one  half  of  the  Cancellation  blank  and  one  half  of  the 
Checking  blank.  The  halves  of  these  blanks  have  been  found  by 
Woodworth  and  Wells  to  be  equal  in  difficulty  and  they  suggest 
that  one  half  of  the  blank  in  the  case  of  both  these  tests  is  a  suf- 
ficient test.  Thus  we  were  able  to  avoid  undue  eye-strain  and  were 
further  able  to  spend  the  extra  time,  saved  from  halving  these  two 
tests,  in  lengthening  three  of  the  Association  tests. 
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Materials:  Woodworth- Wells  number  blank,  Form  A.87  Stop 
watch.  A  pencil  was  used  for  checking. 

Instructions:  After  placing  the  blank  on  the  table  before  the 
subject,  face  downwards,  the  following  instructions  were  given: 
"When  I  say  'Go*  I  want  you  to  turn  over  this  sheet  of  paper,  and 
cross  out  all  the  3's,  as  quickly  as  possible,  going  across  the  paper 
like  this  (illustrating).  There  are  five  3*s  on  every  cross  line  so  you 
want  to  be  sure  to  cross  out  all  those  on  the  first  line  before  passing 
to  the  second  line.  Start  when  I  say  'Go.' n 

Method  of  scoring:  The  time  taken  to  complete  the  cancellation 
was  the  score.  Errors  were  very  rare  and  were  therefore  entirely 
disregarded. 

Results:  Table  III  indicates  the  performance  in  this  test. 


Test  No.  3 
Cancellation 

Group  I 
Group  II 


TABLE  III 

Rant* 

Poorest 

Best 

(Av.  of 

(Av.  of 

Average 

S.  D. 

lowest  5) 

best  5) 

76.51 

17.51 

128.28 

5212 

ad*. 

7677 

13.82 

IO5.60 

50.76 

9Ct> 

Test  No.  4.     Checking 

This  test  measures  functions  similar  to  those  employed  in  the 
Cancellation  test,  although  here  the  functions  involved  are  more 
complex.  To  quote  Woodworth  and  Wells,  "The  detection  of  a 
pair  of  digits  in  a  group  is  a  specialized  performance,  not  reducible 
to  the  acts  of  detecting  the  single  digits.  The  difficulty  of  this  test 
is  mainly  perceptual  and  the  overlapping  which  is  effective  in  find- 
ing pairs  of  digits  must  occur  in  the  perceptive  process."  *8  Inas- 
much as  Professor  Woodworth  found  the  first  half  of  his  number 
blank,  Form  B,  to  be  equal  in  difficulty  to  the  second  half,  for  the 
reason  mentioned  under  "Cancellation"  only  one  half  of  this  blank 
was  employed. 

Materials:  Woodworth-Wells'  number  blank,  Form  B.  Stop 
watch.    Pencil. 

Method  of  procedure:  As  in  the  Cancellation  Test,  the  blank 
was  placed  before  the  subject,  face  downwards,  and  the  following 
instructions  were  given:  "When  I  say  'Go*  I  want  you  to  turn  this 

**  Woodworth*  R.  S.,  and  Wells,  F.  L.  Association  Tests.  Psychological  Monograph,  No.  57. 
191 1.  P.  24. 

»  Woodworth,  R.  S.,  and  Wells,  F.  L.(  Op.  dt. 


24  Psychological  Examinations  of  College  Students 

paper  over  and  check  any  way  at  all,  as  quickly  as  possible,  all  the 
numbers  that  contain  both  a  Q  and  a  6.  Start  when  I  say  'Go.' " 

Method  of  scoring:  The  total  number  of  checks  to  be  made  was 
35.  Therefore  the  score  was  obtained  by  dividing  the  time  taken 
by  the  subject  by  the  number  of  correct  checks  made  and  then 
multiplying  by  35.  No  account  was  taken  of  wrong  checks  made  as 
it  was  believed  that  the  time  spent  in  making  them  sufficiently 
penalized  the  subject. 

Results:  Table  IV  shows  the  f>erformance  attained  in  this  test. 


TABLE  IV 

Average 

S.D. 

Rmntt 
Poorest              Beat 
(Av.  of            (At.  of 
lowest  s)           best  s) 

IO2.93 

19.64 

152.28 

72.6 

sec. 

IO5.98 

2045 

1 6l.O 

76.86 

Test  No.  4 
Checking 

Group  I 

Group  II 

Test  No.  5.     Color  Naming 

"This  is  a  test  of  discrimination-reaction,  involving  prompt 
decision  and  correct  reaction  to  a  situation." 

Materials:  Woodworth-Wells'  Color  Naming  blank.**  Stop 
watch. 

Method  of  procedure:  Preliminary  to  the  actual  test  the  blank 
was  placed  before  the  subject  with  only  the  sample  line  of  five 
colors  showing.  The  subject  was  then  asked  to  give  the  names  of 
each  color.  Then  the  following  directions  were  given:  aI  want  you 
to  name  all  these  colors  for  me,  as  quickly  as  possible,  going  across 
the  paper,  from  left  to  right,  as  in  reading.  Start  when  I  say  'Go.'* 

Method  of  scoring:  The  score  was  the  time  taken  by  the  subject 
to  complete  the  entire  series  of  100  reactions. 

Results:  The  results  are  shown  in  Table  V. 


Test  No.  s 
Color  Naming 

Group  I 
Group  II     . 

*•  Op.  cit. 


TABLE  V 

Jtewgs 

Poorest 

Best 

(Av.  of 

(Av.of 

Average 

S.  D. 

lowest  s) 

bests) 

56.01 

8-75 

78.84 

41.16 

9Cv-« 

9t*^*» 

ScC* 

58.55 

936 

81.32 

39.0 

sec. 

aec 
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Test  No.  6.    Directions 

This  test  measures  the  subject's  speed  in  apprehension  and  her 
general  intelligence. 

Materials:  Woodworth-Wells'  Hard  Directions  blank.  Stop 
watch. 

Instructions:  "When  I  say  'Go'  I  want  you  to  turn  this  blank 
over  and  follow  directions — do  just  what  the  directions  say,  as 
quickly  as  possible." 

Method  of  scoring:  The  score  is  the  time  in  seconds  required  to 
complete  the  test.  Errors  were  counted  separately. 

Results:  Table  VI  indicates  the  performance  in  this  test. 


Test  No.  6 
Directions 

Group  I 
Group  II 


TABLE  VI 

Rant* 

Poorest 

Best 

(At.  of 

(At.  of 

Average 

S.D. 

lowest  5) 

bests) 

126.15 

52.00 

296.6 

64.08 

HOC. 

flAA 

8cC. 

1 19.76 

41.65 

243.2 

61.6 

Test  No.  7.     Opposites 

For  a  test  which  would  indicate  a  general  tendency  or  "adjustment 
to  react  according  to  instructions"  and  also  measure  the  quickness 
and  accuracy  of  association  of  ideas,  the  two  equal  lists  of  opposites 
proposed  by  Woodworth  and  Wells  were  combined  into  one  list. 
Our  reason  for  combining  the  lists  was  in  order  to  get  a  real  measure 
of  the  individual's  ability  to  name  opposites.  If  we  had  taken  only 
the  short  list  we  would  have  obtained  an  adequate  measure  of  the 
subject's  alertness  of  attention  and  ability  to  adapt  herself  to  a 
situation,  but  we  desired  to  go  further  than  this  and  find  out  whether 
the  individual  really  had  any  special  ability  for  naming  opposites. 
This  test  also  indicates  facility  in  handling  words  and  is  generally 
considered  to  have  a  high  correlation  with  general  intelligence. 

Materials:  Woodworth-Wells'  Lists  of  Opposites  printed  on 
cardboard.  Stop  watch. 

Method  of  procedure:  These  instructions  were  given:  "I  want 
you  to  name  the  opposite  for  each  one  of  these  words  (showing 
card  with  lists,  at  a  distance)  as  quickly  as  possible,  not  repeating 
the  words  themselves  but  just  naming  the  opposite.  For  instance, 
if  the  word  were  'tall,'  you  would  say  'short.'  Be  sure  you  give  the 
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exact  opposite  of  each  word  before  proceeding  to  the  next.  Do  you 
understand?" 

The  subject  was  stopped  if  a  wrong  opposite  was  given  and  not 
permitted  to  proceed  with  the  other  words  until  the  right  opposite 
was  given. 

Method  of  scoring:  As  no  errors  were  permitted  to  be  made  in  the 
test,  the  score  represents  the  time  taken  for  completing  the  task. 

Results:  Table  VII  indicates  the  results  obtained  in  this  test. 

TABLE  VII 


Test  No.  7  (Av.  of  (Av.  of 

Opposite!  Average  S.  D.  lowest  5)  beat  5) 

Group  I 51.08  10.33  79-oo  34.84 


Group  II 50.88  8.55  71.52  35.92 

Test  No.  8.     Verb-object 

This  is  also  one  of  the  association  tests  and  measures  ability  to 
handle  verbal  relations.  As  in  the  Opposites  Test  we  combined  the 
two  equivalent  lists  of  verbs  proposed  by  Woodworth  and  Wells 
into  one  test.  Desire  to  obtain  a  real  measure  of  the  subject's 
innate  ability  to  name  objects  was  the  reason  for  lengthening  this 
test. 

Materials:  Two  equal  lists  of  verbs  combined  into  one  list  and 
printed  on  cardboard.  Stop  watch. 

Method  of  procedure:  These  instructions  were  given:  "In  this 
case  I  want  you  to  name  an  object  for  each  one  of  these  verbs,  as 
quickly  as  possible,  not  repeating  the  verbs  themselves  but  simply 
naming  the  objects.  For  instance,  if  the  verb  were  'bake/  you 
would  say  'bread*  or  'cookie.'   Do  you  understand?" 

Method  of  scoring:  As  no  errors  were  permitted  to  be  made,  the 
score  presents  the  time  required  to  complete  the  test. 

Results:  The  results  are  indicated  in  Table  VIII. 


R<*H£€ 

Best 
Test  No.  8  (Av.  of  (Av.  of 

Verb-object  Average  S.  D.  lowest  5)  best  5) 

Group  I 65.55  12.32  99.56  45.48 

BCV. 

Group  II 67.35  12.91  99.08  47.24 

8Cv. 


TABLE  VIII 

J 
Poorest 
(Av.  of 

Average 

S.  D. 

lowest  5) 

65.55 

12.32 

9956 

BCV. 

6735 

12.91 

99.08 
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Test  No.  g.     Mixed  Relations  or  Analogies 

This  test  measures  facility  in  handling  associations,  and  ability 
to  perceive  relationships  among  logical  material.  As  in  the  two 
preceding  Association  Tests  the  two  equal  lists  proposed  by  Wood- 
worth    and    Wells    ("Eye:     see  =  Ear ;    Oyster:     shell  = 

Banana: n  and  "Good:  bad  =  Long: ;  Man:  woman 

«=  Boy: n)  were  combined  into  one  long  list  for  a  reason 

similar  to  that  which  led  us  to  lengthen  the  Verb-object  and  Oppo- 
sites  tests. 

Materials:  Combination  of  Woodworth  Wells'  two  equal  lists 
for  Mixed  Relations  test,  printed  on  cardboard.  Stop  watch. 

Method  of  procedure:  The  subject  was  shown  sample  analogies 
and  the  following  instructions  given:  "In  this  case  there  are  three 
words  given  and  you  are  to  supply  a  fourth  word  that  has  the  same 
relation  to  the  third  word  as  the  second  word  has  to  the  first.   For 

example,   in   this  case,   'Box:    square  =  Orange: ,'   square 

gives  the  shape  of  the  box.  Then  the  shape  of  an  orange  is  round, 
so  you  would  supply  'round*  as  the  fourth  term.  (Two  other  illus- 
trations were  then  given.)  The  relations  involved  won't  always  be 
the  same;  it  may  be  the  case  of  shape,  or  opposites,  etc.  But  you 
look  at  the  first  pair  of  terms  in  every  case  and  then  make  the 
second  pair  express  the  same  relationship  as  the  first  pair.  Do  you 
understand?1' 

Method  of  scoring:  As  no  mistakes  were  allowed,  the  score  is 
the  time  required  to  complete  the  test. 

Results:  The  results  are  shown  in  Table  IX. 


Test  No.  9 
Mixed  Relations 

Group  I 


Group  II 


,BLE  IX 

Rang* 

Poorest 

Best 

(Av.  of 

(Av.  of 

Average 

S.  D. 

lowest  5) 

bests) 

139.64 

42.97 

266.6 

82.88 

sec. 

tHXt 

131.66 

3297 

227.2 

79-56 

cKXi 

sec. 

Test  No.  10.     Word  Building 

For  a  test  that  would  indicate  ingenuity  and  skill  in  the  manipu- 
lation of  letters  and  give  a  measure  of  the  subject's  command  of 
vocabulary,  the  word  building  test  was  used.  The  number  of  words 
written  in  a  given  time  depends  in  part  on  whether  the  subject 
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proceeds  with  a  definite  plan,  combining,  for  example,  "a"  with  all 
the  other  letters,  then  V  with  all  the  other  letters,  etc.,  or  goes 
about  the  task  in  a  vague  or  random  fashion. 

Materials:  Sheet  of  paper  at  the  top  of  which  were  written  the 
letters  a    e    i    I    p    r. 

Method  of  procedure:  The  procedure  as  given  by  Whipple  *°  was 
followed  with  the  exception  that  the  time-limit  was  three  minutes 
instead  of  five. 

Method  of  scoring:  The  score  represents  the  number  of  words 
written.  A  word  was  considered  correct  if  it  is  included  in  Whipple's 
list  of  admitted  words. 

Results:  Table  X  shows  the  results  secured  in  this  test. 


Test  No.  xo 
Word  Building 

Group  I 


TABLE  X 

Avenge 

S.D. 

Rmng* 
Poorer             Best 
(A*,  of            (At.  of 
loves*  5)           best  s) 

16.33 
words 

4-93 

6.0 

27.2 

16.23 

4.52 

6.4 

24.6 

Group  II 

Test  No.  11.     Word  Naming 

This  uncontrolled  association  test  appears  to  be  a  good  test  for 
determining  individual  differences,  the  subjects  tending  to  write 
words  belonging  to  various  categories.  Such  differences  as  the 
tendency  to  write  series  of  rhymed  words,  to  write  a  series  of  words 
that  are  grouped  about  one  central  idea,  then  to  write  another 
series  of  words  grouped  about  a  second  central  idea,  suggested 
perhaps  by  the  last  word  in  the  first  series,  etc.,  are  revealed  in  this 
test.   It  also  depends  in  part  on  the  subject's  speed  of  writing. 

Materials:  Stop  watch.  Sheet  of  paper  and  pencil. 

Instructions  as  follows  were  given:  aI  am  going  to  give  you  three 
minutes  in  which  to  write  all  the  words  you  can.  It  makes  no  dif- 
ference what  sort  of  words  they  are — they  can  be  anything  you 
want  to  write." 

Method  of  scoring:  The  score  equals  the  number  of  words  written. 

Results:  Table  XI  shows  the  results  for  this  test. 

Test  12.    Knox  Cube 

This  test  gives  an  indication  of  the  subject's  power  of  observa- 
tion, memory,  and  ability  to  concentrate  her  attention.   It  involves 

♦°  Whipple,  G.  M.  Manual  of  Mental  and  Physical  Tests.  Part  II.  p.  275. 
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the  ability  to  handle  concrete  objects  and  to  imitate  another's 
performance  with  accuracy. 


Test  No.  xz 
Word  Naming 

Group  I 


TABLE  XI 

Average 

S.D. 

Range 
Poorest             Beit 
(Av.  of            (Av.  of 
lowest  5)          best  5) 

67.14 
words 

12.78 

4O.8 
words 

94.2 
words 

67.87 

11.86 

45.0 

93.0 

Group  II 

Materials:  Five  one-inch  cubes. 

Method  of  procedure:  Piritner's  standardization  of  the  Knox 
test  was  followed.  Care  was  exercised  to  execute  all  movements 
slowly  and  deliberately  and  at  a  uniform  rate. 

Method  of  scoring:  The  score  represents  the  number  of  lines 
correctly  imitated. 

Results:  Results  are  indicated  in  Table  XII. 


Test  No.  la 
Cube 


Group  I 
Group  II 


TABLE  XII 

Range 

Poorest 

Best 

(Av.  of 

(Av.  of 

Average 

S.  D. 

lowest  5) 

bests) 

9.20 

1.56 

5.8 

II.4 

lines 

8.82 

1.64 

4.8 

12.0 

lines 

Test  No.  13.    Digit  Span 

To  measure  ability  to  reproduce  with  accuracy  disconnected  and 
non-logical  material,  the  digit  span  test  was  employed.  It  tests  the 
subject's  power  to  concentrate  her  attention  upon  the  series  of 
digits  as  they  are  read  aloud  to  her  by  the  experimenter  and  to  so 
retain  said  series  in  her  mind  that  she  may  reproduce  it  with  abso- 
lute accuracy  immediately  after  the  experimenter  has  ceased 
speaking.  It  affords  an  opportunity  also  to  observe  individual 
differences. 

Materials:  Digit  Span  blank.  Stop  watch. 

Method  of  procedure:  These  instructions  were  given:  "I  am 
going  to  read  some  numbers  to  you  and  as  soon  as  I  have  finished 
saying  them,  I  want  you  to  repeat  them  in  exactly  the  same  order." 
The  smallest  number  of  digits  given  was  five.   Three  trials  were 
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given  lor  each  number.  The  attempt  was  made  to  repeat  the  num- 
bers without  rhvthm. 

Method  of  scoring:  The  score  represents  the  highest  number  of 
digits  correctly  repeated  two  trials  out  of  three. 

Results:  Table  XIII  indicates  the  results  of  this  test. 


Rmnge 


TABLE  XIII 


(Air.  of  (Av.  of 

Avence  S.  D.  lowest  5)  best  5) 

Group  I  739  digits         1.31         5  digits      10.2  digits 

Group  II  7.67      «  *         1.29         5.2    «         10.2      • 

Test  No.  14.     Word  Memory 
Test  No.  15.    Logical  Memory 

Both  of  these  tests  call  into  play  functions  similar  to  those 
demanded  in  the  digit  span  test.  However,  here  the  material  to  be 
reproduced  has  meaning,  consisting  in  Test  14  of  a  series  of  con- 
crete words  and  in  Test  15  of  a  list  of  familiar  proverbs. 

Materials:  Cards  containing  a  list  of  25  words  and  a  list  of  25 
proverbs,  respectively.  Also  two  blanks  containing  50  words  and 
50  proverbs,  respectively.  The  cards  and  blanks  were  those  em- 
ployed by  Edith  Mulhall  Achilles.41 

Method  of  procedure:  Instructions  were  given  as  follows:  ul  am 
going  to  let  you  look  at  a  list  of  words  (or  proverbs  as  the  case 
might  be)  for  one  minute,  after  which  I  am  going  to  ask  you  to  write 
as  many  of  the  words  (or  proverbs)  as  you  remember. n  The  subject 
was  allowed  one  minute  in  which  to  write  down  the  words  she 
remembered  and  two  minutes  to  write  the  proverbs.  After  record- 
ing the  words  remembered  the  subject  was  given  a  second  list  in 
which  there  were  25  words  previously  seen  and  25  new  words,  and 
was  asked  to  mark  "y"  all  the  words  she  recognized  as  having  seen 
before  and  "nw  those  she  thought  she  had  not  seen.  Similar  pro- 
cedure was  followed  for  the  test  with  proverbs. 

Method  of  scoring:  For  Recall  the  number  of  words  or  proverbs 
written  constitutes  the  score.  No  account  was  taken  of  the  order 
in  which  they  were  recalled,  or  any  false  recollections  recorded. 

In  scoring  Recognition  this  formula  was  employed  to  derive  the 
score : 

41  Achilla  Edith  Mulhall.  Archives  oi  Ptyvhofacv.  x<>.  44.  l9i0* 
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50  (which  is  the  total  number  of  words  or  proverbs)  minus  2  x 
number  of  errors  =  score. 

Results:  Tables  XIV  and  XV  indicate  the  results  of  these  tests. 


TABLE  XIV 


Test  No.  14 

Word  Memory — 

Recollection 

Group  I 
Group  II 


Average 

1 1.59  words 
IO.91       * 


Word  Memory — Recognition 

Group  I 

Group  II 


35.84 
3507 


S.D. 

2.70 
2.79 


7-44 
8.33 


Rant* 
Poorest  Best 

(Av.  of  (Ay.  of 

lowest  s)  best  5) 

6.6  words  17.4  words 
6.2       ■      18.0      " 


20.0 

14.8 


472 
48.4 


a 
« 


TABLE  XV 

Test  No.  1% 
Logical  Memory — 

Recollection  Average  S.  D. 

Group  I 6.19  1.74 

Group  II 6.50  1.76 

proverbs 

Logical  Memory — Recognition 

Group  I 36.75  8.95 

Group  II 37.47  7.69 


Rani* 

Poorest  Best 

(At.  of  (Ay.  of 

lowest  5)  best  5) 

3-0  9.6 

3.2  9.8 

proverbs  proverbs 


17.2 
18.4 


47.6 
48.4 


Test  No.  16.    Substitution 

For  a  test  which  would  measure  speed  of  learning  new  associa- 
tions the  Substitution  test  was  employed.  In  this  test  a  key  is 
constantly  referred  to  and  as  the  test  proceeds  it  is  gradually  learned, 
the  subject  depending  less  and  less  upon  it.  Comparison  between 
the  time  taken  to  complete  the  first  and  second  halves  of  the  blank 
gives  a  measure  of  the  amount  of  time  saved  from  learning  the  key. 

Materials:  Substitution  test  blank.  The  blank  with  5  geometrical 
forms  was  used.  Stop  watch. 

Method  of  procedure:  The  key  was  explained  to  the  subject  and 
then  the  blank  was  placed  face  downwards  before  her  and  she  was 
instructed  to  turn  over  the  Substitution  blank  at  the  signal  agow 
and  to  begin  with  the  first  form  and  take  each  one  as  it  came,  going 
across  the  paper  from  left  to  right,  and  to  write  the  proper  number 
in  each  form  according  to  the  key  at  the  top. 
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Method  of  scoring:  Three  scores  were  taken,  representing  the 
time  for  the  first  half  of  the  blank,  the  second  half  and  the  whole 
blank,  respectively.   Errors,  being  rare,  were  counted  separately. 

Results:  The  data  for  this  test  are  found  in  Table  XVI. 

TABLE  XVI 

Test  No.  16  Avemc  S.  D. 

Substitution — i  Half ....        seconds  seconds        gfcomh 

Group  I  64.33  969  87.68  46.8 

Group  II 66.68  12.14  97-6o  46.0 

Substitution — 2  Half 

Group  I 59- 10  11.62  86.2  37.0 

Group  II 61.51  13.15  91.8  384 

Substitution — Whole 

Group  I 123.09  19.61  167.72  86-48 

Group  II 128.19  23.89         187.0  87.40 

Test  No.  17.     Completion 

For  measuring  correctness  and  facility  in  the  use  of  words,  readi- 
ness in  perceiving  and  comprehending  situations  and  affording 
some  indication  of  creative  ability,  the  Completion  test  was  em- 
ployed. To  quote  Trabue,  "On  the  whole  it  will  be  found  that 
ability  to  complete  these  sentences  successfully  is  very  closely  related 
to  what  is  usually  called  'Language  ability  .' n  * 

Materials:  Trabue  Language  Seal    A.  Stop  watch. 

Method  of  procedure:  The  standard  procedure  suggested  by 
Trabue  was  followed,  a  time-limit  of  four  minutes  being  employed. 

Method  of  scoring:  In  general,  the  method  was  to  follow  Cr. 
Trabue's  scoring;  "A  score  of  2  being  given  each  sentence  if  perfectly 
completed,  a  score  of  1  if  almost  but  not  quite  perfectly  completed, 
and  a  score  of  o  if  not  attempted  at  all  or  if  imperfectly  done." 
Total  of  48  points  is  the  maximum  score  attainable  in  Scale  A. 

Results:  Table  XVII  represents  the  performance  of  the  freshmen 
in  this  test. 

TABLE  XVII 

Range 
Poorest  Beat 

Test  No.  17  (Av.  of  (A v.  of 

Completion  Average  S.  D.  lowest  5)  best  5) 

Group  I 36.08  4.33  26.8  44.8 

Group  II 35.78  4.36  25.2 

•  Trabue.  Completion-Test  Language  Scales. 
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Test  No.  18.    Information 

To  measure  range  of  information  and  obtain  some  conception 
of  the  number  and  kind  of  objects  known  and  the  degree  to  which 
they  are  known,  the  information  test  was  used.  It  tests  the  individ- 
ual's knowledge  rather  than  her  ability. 

Material:  The  information  test  blank  as  specified  in  Whipple's 
Manual,  containing  ioo  words  and  directions  for  marking  them. 

Method  of  procedure:  The  subject  followed  the  directions  at  the 
top  of  the  blank,  marking  each  word  with  a  certain  letter  which 
indicated  the  degree  to  which  it  was  known  to  her.  There  was  no 
time-limit  in  this  test,  the  subject  being  allowed  all  the  time  she 
desired  to  finish  the  blank. 

Method  of  scoring:  The  score  represents  the  number  of  words 
marked  aD,w  aE,w  UF"  and  aN,"  respectively.  As  no  check  was  used 
in  this  test,  the  score  probably  shows  over-estimation.  The  total 
score  was  obtained  by  assigning  these  values:  D  =  3;  E  =  2; 
F  =  1 ;  and  N  =  o,  and  taking  their  sum. 

Results:  The  table  following  indicates  the  results  of  this  test. 

TABLE  XVIII 

Range 
Test  No.  18  Average  S.  D.  Poorest  Best 

Information  D 21.47  words  9.71         3.6  words  41 .6  words 

Information  E 13.70      u  6.16        3         u      28         " 

Information  F 14.81      u  6.43        1.8      "      26.2      « 

Information  N 50.01      a  10.35  &9'6      "29         * 

Total  Score: 

Group  I 106.63  25.51       59.8  158.2 

Total  Score: 

Group  II 104.71  26.79      554  161.8 


Test  No.  ig.     Vocabulary 

This  test  merely  indicates  the  number  of  words  in  the  individual's 
vocabulary. 

Materials:  Vocabulary  test  blank  as  specified  in  Whipple's 
Manual.41 

Method  of  procedure:  The  subject  was  asked  to  follow  the 
directions  given  at  the  top  of  the  test  blank  and  to  mark  the  words 
carefully  according  to  the  directions. 

*Op.  tit.  Vol.  a,  p.  310. 
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Method  of  scoring:  The  score  represents  the  number  of  words 
marked  plus  (+).  This  number  indicates  the  vocabulary-index; 
the  index  taken  as  a  per  cent,  is  multiplied  into  28,000. 

Results:  Table  XIX  shows  the  results  for  this  test. 

TABLE  XIX 


Teat  No.  19  (Av.  of  (A v.  of 

Vocabulary  Average  S.  D.  lowest  5)  beat  $) 

Group  I 74.81  words  6.86  59.6  86.6 

Group  II 73.90      *  7.60  59.4  87.4 


SECTION  V 

NORMS  OF  PERFORMANCE  AND  THEIR  PRACTICAL 

APPLICATION 

To  summarize  the  results  of  the  preceding  section,  Table  XX 
shows  the  norms  of  performance  for  the  two  hundred  Barnard 
freshmen  (Groups  I  and  II),  in  all  the  various  tests.  The  average, 
probable  error,  and  range  from  the  poorest  to  the  best  score  are 
shown  for  each  test.  To  avoid  misrepresentation  of  facts  by  undue 
weight  being  given  extreme  cases,  the  average  of  the  five  poorest 
scores  is  in  each  case  taken  as  the  poorest  score,  and  the  average 
of  the  five  best  scores  as  the  best  score. 

The  following  is  a  comparative  table  comparing  our  results  with 
those  of  other  investigators  who  have  employed  some  of  these  tests 
with  freshmen.  Only  those  cases  are  considered  where  the  tests  are 
identical,  and  the  method  of  scoring  the  same. 


Test 

Barnard  Norm     Bingham 

Kitson 

Other  Investigators 

Cancellation 

76.6  sec.      48.3  sec. 

69.2  sec. 

Color  Naming    . 

57.2   sec.      56.2  sec. 

Hard  Directions 

122.9  sec. 

1 10.9  sec. 

Washburn, 

153 

Opposite* 

50.9  sec. 

52.6  sec. 

Word  Building  . 

16.2   words 

21.4  words 

Sunne, 

18 

Digit  Span   . 

7-53  digits     7    digits 

8.4  digits 

Cattell, 

76 

Information 

20.4  words 

Waugh, 
King  & 
M'Crory, 
Smith, 

24 
10.9 

oCL« 


Figures  1  to  23  inclusive,  show  graphically  the  dispersion  of 
measures  about  the  average  in  the  case  of  the  Barnard  freshmen. 
To  secure  uniformity  and  facilitate  comparison,  the  charts  are 
constructed  with  the  average  in  each  case  as  the  mid-point  and  the 
scores  expressed  in  terms  of  P.E.  units  from  the  average  as  a  center. 
The  P.E.  was  taken  as  the  unit  because  it  is  a  convenient  and 
familiar  measure.  The  vertical  scale  is  also  kept  constant  except 
in  three  tests  where  it  is  changed  for  reasons  to  be  specified  later. 
Inspection  of  these  figures  reveals  many  interesting  features. 

We  may  divide  the  tests  roughly  into  five  groups.44  The  first 
group  contains  the  two  motor  tests — Coordination  and  Tapping. 

«  Justification  of  this  division  of  the  testa  will  be  given  in  Chapter  VI. 
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Here  we  have  fairly  uniform  distributions.  The  actual  range  for 
Coordination  is  from  —  3>£  P.E.  to  +  $y£  P.E.  (skewed  at  the 
positive  end),  and  for  Tapping  from  —5^  P.E.  to  +  7  P.E.  But 
to  take  the  actual  range  as  the  basis  of  our  comparison  is  misleading. 
A  clearer  conception  of  the  facts  is  obtained  by  noting  the  closeness 
with  which  the  measures  distribute  themselves  about  the  central 
tendency.  In  these  two  motor  tests  we  find  a  fairly  uniform  dis- 
tribution, suggesting  that  the  tests  are  adequate  for  selecting  good 
and  poor  subjects  even  in  a  group  as  homogeneous  as  college  fresh- 
men. 

In  the  second  group  we  may  place  those  tests  which  involve 
powers  of  perception  and  comprehension,  namely,  cancellation, 
checking,  color  naming,  word  naming,  and  substitution.  Here 
again  we  find  a  distribution  approximating  the  normal  curve  of 
distribution.  At  first  glance  it  would  appear  that  in  four  of  these 
tests  the  curves  are  skewed  toward  the  negative  or  poor  end.  In 
both  Fig.  3  and  Fig.  4,  (Cancellation  and  Number  Checking),  we 
find  a  case  at  —  T}4  P.E.;  in  Fig.  5  (Color  Naming)  we  find  one  at 
—  7  P.E.;  and  in  Figures  18,  19,  and  20  (Substitution),  we  find 
cases  at  —  9  P.E.;  —  7  P.E.,  and  —  8  P.E.;  while  at  the  good  end 
no  case  exceeds  +  4  P.E.  We  must  take  care,  however,  not  to  let 
these  extreme  cases  mislead  us  as  to  the  general  character  of  the 
distribution.  If  we  count  up  the  cases  on  either  side  of  the  average 
we  find  108  cases  above  the  average  in  Cancellation,  109  in  Number 
Checking,  106  in  Color  Naming,  107  in  Substitution,  and  98  in 
Word  Naming.  Thus  we  really  have  a  more  or  less  uniform  dis- 
tribution with  a  tendency  of  the  number  of  scores  above  the  average 
to  exceed  the  number  below  it.  Disregarding  the  few  extreme  cases, 
we  find  the  majority  of  the  scores  contained  within  the  normal 
limits  of  the  P.E.  distribution,  (—4  P.E.  to  +  4  P.E.). 

In  the  third  group  we  may  place  the  tests  involving  associative 
relations,  namely,  Directions,  Opposites,  Verb-object,  Mixed  Rela- 
tions, Word  Building,  and  Completion.  Here,  likewise,  as  in  the 
two  preceding  groups,  we  find  fairly  uniform  distributions  with  a 
greater  number  of  cases  above  than  below  the  average,  (except  in 
Word  Building,  where  the  distribution  is  about  equal).  The  major- 
ity of  cases  are  likewise  contained  within  the  normal  range  of  8  P.E., 
but  there  are  a  few  extreme  cases  at  the  poor  end  in  Completion, 
Opposites,  Verb-object,  Mixed  Relations,  and  an  extreme  case  at 
both  the  good  and  bad  end  in  the  Word  Building  test. 

The  fourth  group  contains  those  tests  which  call  into  play  powers 
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of  learning,  viz:  observation  and  retention,  namely:  Word  Memory, 
and  Logical  Memory. 

A  word  of  explanation  is  needed  here  regarding  the  construction 
of  the  chart  for  Logical  Memory  (Recollection).  The  categories  into 
which  the  scores  fall  are  so  few  that  the  finest  grouping  possible  is 
in  1  P.E.  units  instead  of  yi  P.E.  units  as  in  the  other  tests.  As 
we  said  before,  to  secure  uniformity  we  let  the  P.E.  represent  the 
same  interval  along  the  base  line  in  all  tests.  Now,  in  order  to  keep 
the  area  of  a  given  number  of  cases  constant  for  all  tests,  it  is  neces- 
sary where  we  have  scores  in  terms  of  1  P.E.  units  to  reduce  the 
vertical  scale  proportionately.  Therefore,  we  regard  the  measures 
as  distributed  evenly  over  the  P.E.  intervals  and  reduce  the  vertical 
scale  one-half.  In  this  test  and  in  Word  Recollection  we  find  a 
greater  number  of  cases  below  the  average  than  above.  The  curve 
is  skewed  toward  the  poor  end  in  Word  Recollection,  and  toward 
the  good  end  in  Word  Recognition  and  Logical  Recognition. 

In  our  fifth  group  we  have  tests  which  depend  on  the  subject's 
knowledge  rather  than  her  innate  ability,  namely,  Information  and 
Vocabulary.  Here  we  find  fairly  uniform  distributions  with  no 
extreme  cases.  This  suggests  the  tendency  of  education  to  make  a 
homogeneous  group  of  individuals  approach  a  general  level  of  per- 
formance in  a  test  of  mere  learning. 

We  have,  finally,  a  miscellaneous  group  which  comprises  the 
Digit  Span  and  Knox  Cube  tests — tests  which  showed  both  a  low 
intercorrelation  and  low  correlations  with  the  other  tests  of  the 
series.  In  the  Knox  Cube  test  the  small  number  of  categories  makes 
it  necessary  to  use  I  P.E.  units  and  in  the  Digit  Span  test  it  is 
necessary  to  use  2  P.E.  units. 

To  sum  up  then,  these  surfaces  of  distribution  are  fairly  symmet- 
rical, if  we  disregard  the  few  extreme  cases.  In  addition,  the  fact 
that  the  averages  and  surfaces  of  distribution  for  the  first  group  of 
one  hundred  freshmen  (Group  I)  are  approximately  the  same  as  for 
the  second  group  of  one  hundred  (Group  II),  corroborates  this  con- 
clusion and  supports  the  view  that  the  norms  here  presented  are 
reliable. 

Academic  Grades 

Besides  their  score  in  the  psychological  tests  we  have  additional 
information  about  the  first  group  of  one  hundred  freshmen  (Group  I) 
in  the  form  of  university  grades  and  records  taken  in  the  gym- 
nasium.   The  college  subjects  may  be  grouped  into  five  classes: 
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I.  Language  (including  English,  Latin,  Greek,  German,  French, 
Italian,  and  Spanish);  2.  Mathematics;  3.  Science  (physics,  chemis- 
try, botany  or  geology);  4.  Philosophy  (including  psychology); 
and  5.  History.  Due  to  the  freedom  allowed  the  students  in  making 
out  their  programs,  the  same  subjects  are  not  taken  by  all,  and  the 
number  of  cases  in  each  class  therefore  varies.  The  letter  system  of 
marking  is  employed  at  Barnard,  the  letters  A  (excellent),  B  (good), 
C  (fair),  D  (Poor),  and  F  (failure),  being  used.  For  the  statistical 
treatment  of  the  data  the  letter  grades  were  transformed  into 
numbers  according  to  the  scale:  A  =  90,  B  =  80,  C  =  70,  D  =  60, 
and  F  =  50.  Norms  for  these  freshmen  in  their  college  work  are 
shown  in  Table  XXI. 

TABLE  XXI 

Academic  Number  of  Range    (Actual) 

Record  Cases     Average      P.  E.      Lowest    Highest 

1.  Language 97  75.31  4.69  50  90 

2.  Mathematics     ....  88  76.99  6.99  50  90 

3.  Science 41  72.26  7.74  50  90 

4.  Philosophy 27  78.15  3.15  60  90 

5.  History 26  72.88  2.88  60  90 

The  averages  tend  to  be  approximately  equal  for  all  subjects 
with  a  nearly  equal  range  of  distribution. 

Physical  Measurements 

Table  XXII  gives  averages,  P.E.'s,  and  range  from  lowest  to  best 
score  of  the  physical  measurements  taken  in  the  gymnasium. 

TABLE  XXII 

Number  Range  (Actual) 

Teat  of  Cases       Average  P.  E.        Poorest      Best 

Height 97  159.92  cm.           4.08  137  172.9 

Weight 97  120.59  lbs.  12.59  90  182 

Lung  Capacity 94  171.05  cu.  cm.     13.50  118  230 

Strength  of  Grip,  r.h 97  30.02  kg.            4.02  13  43 

Strength  of  Grip,  1.  h 97  27.27  kg.             4.27  16  38 

Upper  Back 97  20.60  kg.            3.4  12  42 

Chest 97  19.60  kg.            2.6  11         36 

One  of  the  main  purposes  of  this  investigation,  as  we  remarked 
in  a  preceding  section,  was  to  give  the  individual  student  a  knowl- 
edee  of  her  strengths  and  weaknesses.    Accordingly,  at  the  com- 
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pletion  of  the  entire  series  of  examinations  each  year,  an  individual 
report  was  sent  to  each  student  who  took  the  tests.  This  consisted 
of  two  blanks  giving  a  description  and  interpretation  of  the  various 
tests,  with  whatever  significance  each  test  was  known  to  possess 
from  a  vocational  standpoint.  In  addition  to  these  explanatory 
blanks,  there  was  a  third  blank  which  indicated  the  standing  of  the 
individual  student  in  each  of  the  tests,  together  with  the  average 
standing,  (with  the  P.E.),  in  each  test  for  the  entire  group  of  one 
hundred  freshmen,  so  that  the  individual  could  compare  her  own 
record  with  that  of  the  average  in  every  case. 

The  ideal  plan  would  have  been  for  the  experimenter,  after 
sending  each  student  her  report,  to  have  had  a  personal  interview 
with  her.  In  this  she  could  have  cleared  up  any  difficulties  the 
student  might  have  had  in  interpreting  her  results  and  under- 
standing their  significance.  She  could  also  have  rendered  distinct 
aid  by  suggesting  means  whereby  the  student  could  make  the  best 
use  of  her  abilities,  or  strengthen  her  weak  points.  Where  the  girl 
was  doing  academic  work  of  a  grade  below  the  level  her  test  record 
showed  her  capable  of,  the  experimenter  could  have  sought  to 
.determine  the  cause  of  the  girl's  academic  failure — whether  due  to 
too  many  distractions,  outside  work,  or  what  not — and  given  advice 
accordingly.  Lack  of  time  made  it  impossible  to  do  this,  however. 
We  therefore  have  no  record  of  these  girls  in  their  last  three  years  of 
college  to  show  whether  they  benefited  from  their  test  results.  It 
is  worth  while  at  this  point,  nevertheless,  to  indicate  how  one  may 
proceed  to  make  practical  use  of  these  tests. 

Charts  1  to  6,  inclusive,  represent  the  psychographic  records 
of  six  students  from  Group  I.  They  are  constructed  as  follows: 
Reading  along  the  heavy  horizontal  base  line,  we  have  the  names 
of  the  nineteen  psychological  tests,  (Substitution  First  Half  and 
Substitution  Second  Half  are  omitted  since  ability  in  this  test  is 
adequately  measured  by  Substitution  Whole),  the  academic 
subjects  varying  from  two  to  four,  according  to  the  programs  of 
study,  and  seven  physical  measurements.  Opposite  the  name  of 
each  test,  subject,  and  physical  measurement  is  the  individual's 
score,  and  below  this,  the  amount  of  her  plus  or  minus  deviation 
from  the  average  scores  expressed  in  P.E.  units.  To  make  the 
individual's  relative  standing  more  concrete,  her  score  in  P.E. 
units  is  also  expressed,  in  terms  of  what  her  position  would  be  in  a 
group  of  one  hundred  freshmen,  selected  at  random. 

The  vertical  line  (reading  up  from  the  base  line)  is  divided  into 
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equal  divisions,  indicating  position  in  a  group  of  one  hundred  fresh- 
men selected  at  random,  using  the  norms  of  Table  XX  as  the  basis. 
No.  1  is  considered  the  poorest  individual  in  each  case,  No.  100  the 
best.  The  heavy  horizontal  black  line  in  the  center  represents  the 
average  individual  or  the  50th  individual  in  the  group.  To  illus- 
trate the  use  of  these  charts  let  us  consider  Chart  I,  A.M.'s  record. 
In  coordination  this  individual  scores  96.  Referring  to  Table  XX, 
we  see  that  the  average  freshman  score  for  this  test  is  83.42  with  a 
P.E.  of  7.5.  A.M.'s  deviation  from  the  average  score  is,  therefore, 
+  12.58  (96—83.42)  -5-  7.5  (the  P.E.)  or  +  1.67  P.E.  units  above 
the  average.  We  know  from  the  normal  curve  of  distribution  that 
between  the  average  and  +  1  P.E.  are  found  25%  of  the  cases,  or 
25  cases  in  a  group  of  one  hundred  individuals.  Between  1  P.E. 
and  +  2  P.E.  there  are  approximately  17%  more  cases,  or  17  in  a 
group  of  one  hundred  individuals,  so  that  if  a  girl  made  a  score 
of  +  2  P.E.  she  would  rank  50  (average)  +  25  +  17,  or  92  in  the 
group.  A.M.,  however,  does  not  quite  reach  this  score.  Her  score 
reaches  only .67  of  the  interval  between  +  1  P.E.  and  +  2  P.E.,  or, 
.67  of  the  17  cases  contained  within  these  limits.  Now  .67  X  17  ■= 
H-39,  *•  *•,  A.M.'s  score  is  that  of  the  nth  individual  in  this  group. 
This  is  only  her  approximate  position,  of  course,  since  the  scores  are 
not  distributed  evenly  over  the  interval.  To  secure  her  exact 
position  we  would  transform  her  P.E.  score  into  rank  according  to 
proper  table.16  She  therefore  stands  50  +  25  +  n,  or  86  in  a  group 
of  one  hundred  freshmen  in  coordination.  In  Tapping  her  score  is 
368  taps.  The  average  freshman  score  in  this  test  is  372.4  taps  with 
a  P.E.  of  27.6.  A.M.'s  deviation  from  the  average,  accordingly,  is 
—  4.4  (372.4  —  368);  her  deviation  in  terms  of  P.E.  is  —  4.4  + 
27.6  (the  P.E.),  or  she  is  —  .15  P.E.  units  below  the  average.  Her 
score  therefore  reaches  .15  of  the  25  cases  in  the  interval  between 
the  average  and  —  1  P.E.  Now,  .15  X  25  =  3.75.  Her  score  there- 
fore gives  her  a  rank  3.75  or  approximately  4  places  below  the  aver- 
age or  50th  individual,  i.  e.,  she  stands  46  in  a  group  of  one  hundred 
freshmen.  A  similar  method  was  employed  in  finding  out  the 
psychographic  records  of  the  other  five  students.  Considering  the 
net  scores  in  the  psychological  tests,  A.M.  ranked  97  in  Group  I, 
only  three  individuals  surpassing  her.  When  we  group  the  tests 
under  the  five  divisions  suggested  above,  we  see  that  although  she 
would  stand  well  above  the  average  in  a  random  group  of  one  hun- 
dred freshmen,  she  makes  her  highest  rank  (88  average  rank  for 

"  Thorndike,  E.  L.  Mental  and  Social  Measurements. 
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this  group)  in  the  group  of  tests  which  involve  the  association 
processes,  i.  e.t  in  those  tests  involving  more  complex  and  higher 
abilities.  Moreover,  she  made  the  highest  standing  in  academic 
marks  of  any  freshman  in  Group  I,  being  the  only  one  to  secure 
grade  A  in  all  the  subjects  she  pursued  during  the  year.  It  is  of 
interest  to  note  also  that  the  subject's  score  in  physical  measure- 
ments is  above  the  average.  The  tests  therefore  give  an  adequate 
measure  of  this  student's  ability. 

Chart  2.  L.H.C.  This  freshman  presents  the  other  extreme  of 
ability.  With  the  lowest  academic  standing  of  Group  I,  (having 
no  mark  higher  than  D  grade),  she  also  ranks  only  26  in  net  test 
score.  She  is  especially  deficient  in  the  association  tests.  In  a 
random  group  of  one  hundred  freshmen  she  would  rank  only  1  in 
Opposites  and  Mixed  Relations,  showing  poor  powers  of  associating 
ideas  and  perceiving  relationships  among  logical  material,  and  8  in 
Completion,  which  measures  readiness  in  perceiving  and  compre- 
hending situations.  She  is  also  poor  in  the  memory  tests.  In  the 
second  group  of  tests  which  involves  ability  to  perceive  what  is 
wanted  and  to  carry  out  simple  instructions,  she  ranks  above  the 
average,  suggesting  that  she  would  do  well  at  simple  types  of 
clerical  or  stenographic  work,  though  she  lacks  ability  to  perform 
work  requiring  a  higher  level  of  intelligence.  In  Information  and 
Vocabulary  her  low  rank  of  4.5  is  what  we  would  expect.  Having 
no  aptitude  for  study,  it  is  only  natural  that  she  should  be  unin- 
terested in  it.  Her  physical  report  was  also  below  average.  All 
indications  confirmed  her  psychological  report  that  she  was  unfitted 
to  pursue  college  work.  Her  failure  to  meet  the  academic  standard 
set  for  freshmen  necessitated  her  withdrawal  from  college  at  the 
end  of  the  year — a  course  justified  by  her  psychological  record. 

Chart  3.  G.S.  Although  in  academic  work  this  individual  ranked 
only  21  in  the  group  of  one  hundred,  her  net  score  in  the  psychologi- 
cal tests  gave  her  a  rank  of  74.  Her  record  in  Group  3,  i.  e.f  in  the 
tests  requiring  the  highest  mental  abilities,  indicated  that  she  was 
doing  work  of  a  grade  far  below  her  ability.  Her  net  score  in  the 
tests  of  Group  4  suggested,  and  her  record  in  the  Information  and 
Vocabulary  tests,  which  depend  chiefly  on  knowledge  acquired, 
corroborated  the  hypothesis  that  she  was  neglecting  her  college 
work.  In  her  case  interest  in  athletics  furnished  the  explanation 
for  her  college  record.  Not  only  was  her  physical  record  the  highest 
in  the  class,  but  G.S.  was  a  prominent  figure  in  all  college  athletic 
events,  especially  in  the  swimming  meets  and  in  basket-ball  games. 
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Chart  4.  I.E.  This  case  parallels  L.C.'s.  I.E.'s  net  academic 
rank  was  only  3  and  her  rank  in  the  tests  was  also  below  freshman 
standard.  Like  L.C.,  also,  I.E.'s  withdrawal  from  college  at  the 
end  of  her  first  year  was  fully  justified. 

Chart  5.  L.J.H.  Here  we  have  a  case  of  a  girl  with  a  physical 
record  above  the  average,  and  a  rank  of  95  in  academic  standing, 
but  whose  net  score  in  the  psychological  tests  is  only  17.  Having 
no  other  information  about  this  girl  besides  the  test  data  and  her 
school  marks,  we  cannot  definitely  explain  this  case.  In  only  six 
of  the  tests  does  she  rank  above  average,  but  two  of  these — Mixed 
Relations  and  Completion — involve  the  most  complex  mental 
functions,  powers  of  understanding,  and  reasoning.  It  may  be  that, 
lacking  powers  of  immediate  recall,  this  girl  was  willing  to  devote 
long  hours  to  grasping  the  subject  matter  of  her  studies  so  that  by 
extra  effort  she  was  able  to  make  high  grades.  Her  score  in  Infor- 
mation and  Vocabulary  also  suggests  her  attention  to  her  studies. 

Chart  6.  M.M.  This  case  presents  the  other  extreme.  Here 
we  have  a  freshman  who  is  in  fine  physical  condition  and  has  a  net 
score  of  77  in  the  psychological  tests,  but  whose  net  academic 
standing  is  only  26.  Inasmuch  as  she  stands  well  above  the  average 
in  all  the  tests  involving  the  higher  mental  processes,  her  academic 
failure  is  probably  due  to  lack  of  interest  in  her  studies,  or  to  too 
many  outside  activities. 


SECTION  VI 

INTER-TEST  CORRELATIONS  AND  THEIR 

SIGNIFICANCE 

The  psychographic  charts  showed  that  a  freshman  rarely  did 
equally  well  in  all  the  psychological  tests.  Whereas  she  tended  to 
make  approximately  the  same  standing  in  all  her  academic  subjects, 
she  showed  no  such  uniformity  in  the  psychological  tests.  There 
were,  of  course,  a  few  extreme  cases  where  a  good  student  scored 
above  average  in  the  majority  of  the  tests,  (for  example,  A.M.),  or 
a  poor  student  scored  below  average,  (for  example,  L.H.C.).  This 
raises  the  interesting  question:  Just  what  is  the  nature  of  the 
relationship  existing  between  these  tests?  Are  some  more  closely 
related  than  others?  Is  there  any  evidence  to  support  our  division 
of  the  tests  into  the  groups  suggested  in  the  preceding  section? 
For  determining  the  relationship  between  the  tests  the  particular 
method  of  correlation  used  in  this  investigation  was  one  suggested 
by  Professor  Woodworth  for  combining  the  results  of  several  tests.41 
By  the  use  of  his  method  it  is  possible  to  assign  each  individual  her 
position  in  the  distribution  of  the  group;  she  stands,  in  other  words, 
"above  or  below  the  group  average  and  so  and  so  much  above  or 
below  as  compared  with  the  average  variation  of  the  group."  The 
method  of  procedure  is  as  follows:  The  average  of  any  test  is  regard- 
ed as  zero,  and  the  individual's  standing  is  expressed  as  a  deviation 
above  or  below  the  average.  Then  the  measure  of  variability  (in 
this  case  the  S.D.)  is  taken  as  the  unit  of  deviation  from  this  zero, 
and  all  deviations  are  expressed  as  fractions  or  multiples  of  the  unit. 
Each  individual  deviation,  then  divided  by  the  S.D.  of  the  series, 
gives  a  resulting  quotient  called  the  "reduced  measure."  Having 
obtained  the  reduced  measures,  by  appropriate  substitution  in  the 
Pearson  formula  for  correlation,  we  may  easily  obtain  the  correla- 
tion of  two  given  tests  A.  and  B.,  for,  given  the  reduced  measures 
of  two  arrays,  the  coefficient  of  correlation  between  them  is  the 
average  of  the  products  of  the  various  reduced  measures.  The 
advantage  of  using  this  method  is  that  the  net  position  of  an  in- 
dividual in  a  group  of  tests,  for  example,  in  the  twenty-three  tests 

*  Woodworth.  R.  S.   Combining  the  Results  of  Several  Tests;  A  Study  in  Statistical  Method. 
From  Psychological  Review.  March.  1012. 
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here  used,  may  be  easily  obtained  by  dividing  the  sum  of  her  reduced 
measures  in  those  tests  by  the  number  of  tests,  (twenty- three  in  this 
instance). 

Table  XXIII  gives  the  inter-test  correlations  computed  according 
to  this  method.  The  test  records  used  in  obtaining  these  correla- 
tions are  those  of  the  one  hundred  freshmen  of  Group  I.  Inspection 
of  this  table  reveals  many  interesting  features.  The  correlations 
range  from  +  .77  (between  Cancellation  and  Digit  Span)  to  .00 
(between  Tapping  and  Word  Recollection,  and  between  Mixed 
Relations  and  Word  Recollection).  The  highest  correlations  are 
+  .77  (between  Cancellation  and  Digit  Span) ;  +  .58  (Word  Recol- 
lection and  Word  Recognition) ;  +  .57  (Opposites  and  Mixed 
Relations);  +  .56  (Logical  Recollection  and  Logical  Recognition); 
+  .51  (Cancellation  and  Checking) ;  +  .48  (Coordination  and 
Tapping) ;  +  .48  (Mixed  Relations  and  Completion) ;  +  .44  (Oppo- 
sites and  Verb-object);  and  +  .40  (Cancellation  and  Word  Nam- 
ing). That  the  Cancellation  test  furnishes  the  highest  single  corre- 
lation is  interesting  because  it  contradicts  the  old  compensation 
theory  and  McCall's  finding  of  a  negative  correlation  (—  .28) 
between  this  and  the  Trabue  Completion  test.  All  our  correlations 
with  Cancellation  are  positive,  ranging  from  +  .03  to  +  .77. 
Especially  noteworthy  are  the  correlations  of  +  .40  with  Word 
Naming,  +  .30  with  Word  Building,  and  +  .31  with  Substitution — 
all  tests  calling  into  play  the  higher  thought  processes.  The  fact 
that  the  correlations  are  all  positive  is  suggestive  of  a  definite  rela- 
tionship between  cancellation  and  these  various  tests. 

Checking  and  Word  Naming  show  the  highest  average  correlation 
(+  .25)  with  the  other  tests  (omitting  Information,  Vocabulary, 
Word  Recollection,  and  Word  Recognition).  Then,  in  order, 
Opposites,  Verb-object,  and  Cancellation;  Color  Naming,  Direc- 
tions, Mixed  Relations,  Word  Building,  and  Completion;  then, 
Logical  Recollection  and  Substitution  Whole;  Knox;  Tapping,  and 
Digit  Span;  Coordination;  Logical  Recognition.  The  Information 
and  Vocabulary  tests  were  omitted  because  they  showed  no  correla- 
tion with  the  other  tests.  The  Vocabulary  test  has  an  average 
correlation  with  the  other  tests  of  .00,  indicating  chance  relation- 
ship. The  correlations  of  Information  with  the  other  tests  were  not 
worked  out  because  inspection  of  the  scores  showed  that  approxi- 
mately the  same  result  would  be  obtained  as  for  the  Vocabulary 
test. 

On  the  whole,  the  inter-test  correlations,  although  mostly  posi- 
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tive,  are  low.  This  would  indicate  that  we  are  testing  here  different 
mental  abilities.  The  fact  that  we  can  group  certain  tests  together 
on  the  basis  of  relationship  shown  by  the  correlation  coefficients 
further  supports  this  view.  It  is  possible  to  find  several  groups  of 
tests  which  correlate  closely  among  themselves,  but  loosely  with 
the  other  tests.  The  following  table  gives  the  various  groupings 
with  their  correlations: 

TABLE  XXIV 

Grouping  of  Tests  on  the  Basis  of  their  Correlation  Coefficients 

Group     I.   Coordination  and  Tapping,  Correlation  +.48  with  each  other. 

Group   II.   Cancellation,  Checking,  Color  Naming,  Word  Naming,  Substitution. 

Average  Correlation  of  tests  within  group  +.32 

u  "         Cancellation     with  all  others  +-35 

*         Checking  «     u       u  +.36 

Color  Naming      "     «       u  +.27 

Word  Naming      «     u       u  +.34 

Substitution         a     u       u  +.30 

Group  III.    Directions,  Opposites,  Verb-object,  Mixed  Relations,  Word  Building, 

and  Completion. 
Average  Correlation  of  tests  within  group  +.32 

"  u  Directions  with  all  others  +.25 

*  *         Opposites  «     «       «  _j_^0 

Verb-object  *  *  u  +.31 

Mixed  Relations  «  «  .  «  +.40 

a         Word  Building  *  «  a  +.25 

*  u         Completion  «  a  a  +.30 

Group  IV.   Word  Recollection,  Word  Recognition,  Logical  Recollection,  Logical 

Recognition. 

Average  Correlation  of  tests  within  group  +.38 

u               u         Word  Recollection    with  all  others  +.39 

a         Word  Recognition         «     "      *  +.37 

Logical  Recollection      *     •      *  +.40 

"                *         Logical  Recognition       «     «      «  +.$$ 

Group    V.   Information  and  Vocabulary. 

Miscellaneous:  Digit  Span,  Knox  Cube. 

Thus  Tapping  and  Coordination  correlate  +  .48  with  each  other, 
but  both  tests  show  a  much  lower  correlation  with  the  other  tests. 
(The  correlations  outside  of  the  group  range  from  +  .33  to  +  .01). 
This  agrees  with  Thorndike's  theory  that  tests  of  the  motor  sensory 
level  correlate  rather  closely  with  each  other,  but  only  loosely  with 
tests  of  other  levels.  In  Group  II,  Checking  has  an  average  corre- 
lation of  +  .36  with  the  others  of  the  group,  and  also  a  much  lower 
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correlation  with  tests  outside  Group  II,  (ranging  from  +  .30  to 
—  .04).  Similarly,  in  Group  III,  Opposites  and  Mixed  Relations 
both  have  an  average  correlation  of  +  .40  with  the  other  tests  in 
this  group,  but  a  lower  correlation  with  any  test  outside  the  group, 
again  conforming  to  Thorndike's  contention  that  tests  on  the 
associative  level  correlate  closely  with  each  other,  but  rather  loosely 
with  tests  on  other  levels.  (The  average  correlation  of  Opposites 
with  the  tests  outside  Group  III  is  +  .15;  the  average  correlation  of 
Mixed  Relations  with  tests  outside  Group  III  is  +  .10).  In  Group 
IV,  also,  Logical  Recollection  has  an  average  correlation  of  +  .40 
with  the  other  tests  in  the  group,  but  a  lower  correlation  with  any 
test  outside  this  group.  (The  correlations  outside  the  group  run 
from  +  .30  to  +  .01).  Information  and  Vocabulary  differ  from  the 
other  tests  of  the  series  in  that  they  are  indicative  of  one's  learning 
rather  than  one's  innate  ability.  There  is  only  a  chance  correlation 
between  them  and  the  other  tests.  A  more  detailed  discussion  of 
this  relationship  we  will  postpone  till  the  following  section.  As  for 
Knox  Cube  and  Digit  Span,  perhaps  the  best  plan  is  to  consign 
them  to  the  miscellaneous  class.  Knox  Cube  shows  on  the  whole 
the  closest  correlations  with  the  tests  in  Group  II,  but  the  average 
group  correlation  is  not  high  enough  to  warrant  us  definitely  placing 
it  in  this  group  rather  than  in  Group  IV.  In  like  manner,  aside  from 
its  surprisingly  high  correlation  with  Cancellation  (+  .77),  Digit 
Span  shows  no  close  relationship  with  any  other  test.  If  we  omit 
these  four  tests,  (namely,  Information,  Vocabulary,  Knox  Cube, 
and  Digit  Span),  we  do  get  very  definite  groupings  of  the  other 
tests,  as  shown  in  Table  XXII  above,  indicating  that  we  are  measur- 
ing different  abilities.  The  rather  high  intercorrelations  between 
the  tests  of  each  group,  together  with  their  low  correlations  with 
tests  outside  their  own  groups  would  support  this  view.  There  is 
no  evidence  from  these  results  to  support  Spearman's  theory  that 
correlations  are  produced  between  all  sorts  of  performance,  the 
amount  of  the  correlation  being  simply  proportional  to  the  extent 
that  the  performances  concerned  involve  the  use  of  a  general  com- 
mon factor  or  "general  ability."  Our  data  give  evidence  neither  of 
a  common  factor  nor  of  a  hierarchial  arrangement  of  the  correla- 
tions. Attempts  to  arrange  the  correlations  to  form  a  hierarchy 
met  with  even  greater  failure  than  Simpson  reports. 

The  simplest  and  clearest  way  to  explain  the  existing  relation- 
ships between  our  tests  seems,  therefore,  to  arrange  them  in  the 
groups  indicated  in  Table  XX I Y — a  grouping  supported  by  the 
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actual  correlation  coefficients.  The  tests  within  each  group  sea 
to  be  closely  related  to  each  other  because  they  possess  elements  i 
common — elements  serving  to  bind  them  closely  to  each  other,  bi 
loosely  to  tests  without  their  own  groups.  Thus,  Group  I  involve 
motor  capacity  and  skill;  Group  II  powers  of  perception  and  con 
prehension;  Group  III  associational  relations;  Group  IV  pur 
memory.  Though  there  is  some  slight  overlapping  in  the  qualitic 
called  into  play  in  the  various  groups,  nevertheless  it  is  not  suffitien 
to  spoil  our  classification. 

Table  XXV  gives  the  inter-test  correlations  corrected  for  attenua 
tion.  The  correlations  are  all  higher  but  show  in  general  the  sam 
relationship.  They  range  from  +  i.oo  (Cancellation  and  Digi 
Span;  Word  Recollection  and  Word  Recognition;  Word  Recollec 
tion  and  Logical  Recollection)  to  +  .00  (Tapping  and  Word  Recol 
lection;  Mixed  Relations  and  Word  Recollection).  When  the  corre 
lations  are  corrected  for  attenuation,  Logical  Recollection  show 
the  highest  average  correlation  (+  .39)  with  the  other  tests  (Omit 
ting  Information  and  Vocabulary).  Then,  in  order,  Word  Naming 
Substitution,  Word  Recollection  and  Cancellation;  Opposites 
Verb  Object  and  Word  Building;  Checking,  Directions  and  Mixec 
Relations;  Completion  and  Color  Naming;  Word  Recognition  anc 
Logical  Recognition;  Coordination,  Digit  Span,  Knox  and  Tapping 

The  corrected  coefficients  of  correlations  also  support  the  group 
ings  of  tests  given  in  Table  XXIV.  It  is  possible  to  arrange  th< 
attenuated  correlations  in  the  same  groups  as  those  given  by  tin 
raw  correlations.  The  corrected  coefficients  of  correlation  are  highe 
than  the  raw  correlations  but  the  relationship  between  the  tests  i 
similar. 

To  determine  the  reliability  of  the  test  scores,  an  investigatioi 
was  conducted  three  years  after  the  testing  of  the  first  group  of  on 
hundred  freshmen  (Group  I).  Two  trials  of  the  tests  were  give 
to  a  group  of  45  freshmen  during  the  period  extending  from  Marc 
14  to  May  15,  1919,  inclusive.  The  two  trials  occurred  in  ever 
case  on  the  same  day  and  required  approximately  45  minutes  of  th 
student's  time.  Table  XXVI  gives  a  list  of  the  tests  employed  i 
two  trials. 

The  method  of  procedure  in  conducting  these  tests  with  the  4 
freshmen  was  the  same  as  that  employed  with  the  200  freshme 
in  Groups  I  and  II.  Moreover,  all  the  tests  were  conducted  indivic 
ually  just  as  was  done  in  testing  the  freshmen  in  Groups  I  and  II 
and  the  room  employed  for  the  testing  was  the  same  as  in  the  forme 
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1.  Coordination 

2.  Tapping 

3.  Cancellation 

4.  Checking 


5.  Color  Naming 

6.  Directions 

7.  Opposites 

8.  Verb-object 

9.  Mixed  Relations 

10.  Word  Building 

11.  Word  Naming 

12.  Knox  Cube 

13.  Digit  Span 

14.  Word  Recollection 

15.  Word  Recognition 

16.  Logical  Recollection 

17.  Logical  Recognition 

18.  Substitution 


TABLE  XXVI 

Trials  1  and  2  identical,  same  as  with  Groups  I  and  II. 
Trials  1  and  2  identical,  same  as  with  Groups  I  and  II. 
First  half  of  Wood  worth-Wells'  blank  used  in  Trial  if 
and  second  half  in  Trial  2. 

First  half  of  Woodworth- Well's  blank  used  in  Trial  1, 
and  second  half  in  Trial  2. 
Trials  1  and  2  identical. 

Woodworth- Wells'  blank  used  in  Trial  1 ;  Wells' alterna- 
tive form  used  in  Trial  2. 

(The  first  half  of  each  of  these  Woodworth- Wells' 
blanks  was  used  in  Trial  1,  and  the  second  half  in 
Trial  2. 

Letters  a  til  p  r  used  in  Trial  1.   (Same  as  in  groups 
I  and  II).  Letters  a  e  0  b  m  t  used  in  Trial  2. 
Trials  1  and  2  identical. 
Trials  1  and  2  identical. 

Trial  1  as  in  Groups  I  and  II;  equivalent  form  used 
in  Trial  2. 


19.  Completion 


Trial  1  the  same  as  in  Groups  I  and  II;  equivalent 
Mulhall  form  used  in  Trial  2. 

Given  only  once.  (The  closeness  with  which  the  cor* 
relations  of  the  first  half  of  the  test  with  the  other  tests 
agreed  with  the  correlations  of  the  second  half  of  the 
test  with  the  other  tests,  measures  the  reliability  of 
this  test.)  The  correlation  between  the  score  in  the 
first  half  of  the  blank  and  the  score  in  the  second  half 
of  the  blank  was  taken  as  the  measure  of  reliability. 
Given  only  once.  The  correlation  between  the  score  in 
the  odd  numbered  sentences  and  the  score  in  the  even 
numbered  sentences  was  taken  as  the  measure  of 
reliability. 


investigations.  Just  as  we  found  the  average  and  P.E.'s  for  the 
various  tests  to  be  approximately  the  same  for  both  groups  I  and  II, 
so  the  norms  for  this  group  of  45  freshmen  are  approximately  the 
same  as  those  obtained  for  Groups  I  and  II.  Thus,  since  one  group 
of  Barnard  freshmen  appears  very  similar  to  any  other  group  of 
Barnard  freshmen  selected  at  random,  we  may  fairly  assume  that 
the  coefficients  of  reliability  secured  with  any  one  group  will  also  be 
indicative  of  the  relationship  that  would  exist  between  two  trials 
with  any  other  group  selected  at  random.  If,  then,  we  find  the 
reliability  of  the  tests  high  for  this  group  of  45,  it  is  fair  to  judge 
that  it  would  have  been  equally  high  with  the  group  of  100  fresh- 
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men,  (Group  I),  whose  test  scores  were  used  in  computing  tl 
correlations  given  in  Table  XXIII. 

-     TABLE  XXVII 

Test  Correlations  Between  Trial  i  and 
Trial  2 — Group  of  45  Freshmen 

1.  Coordination +.66 

2.  Tapping +.77 

3.  Cancellation +.60 

4.  Checking +.88 

5.  Color  Naming +.88 

6.  Directions +.76 

7.  Opposite* +.79 

8.  Verb-object +.70 

9.  Mixed  Relations +.60 

10.  Word  Building +.70 

11.  Word  Naming +.71 

12.  Knox  Cube +-69 

13.  Digit  Span .      .      .  +.83 

14.  Word  Memory — Recollection *    .      .+.18 

15.  Word  Memory — Recognition +«33 

16.  Logical  Memory — Recollection +.48 

17.  Logical  Memory — Recognition +-73 

18.  Substitution +.70 

19.  Completion +.77 

Table  XXVII  shows  the  correlation  between  the  first  and  secoi 
trial  for  each  of  the  19  psychological  tests.  With  three  exceptions 
Word  Recollection  (+  .18),  Word  Recognition  (+  .33),  and  Logic 
Recollection  (+  .48) — the  correlations  are  high  enough  to  indica 
a  high  degree  of  reliability.  These  reliability  correlations  ran 
from  +  .88  in  the  case  of  checking  and  Color  Naming  to  +-  .60 
the  case  of  Cancellation  and  Mixed  Relations.  If  we  disrega 
Word  Recollection,  Word  Recognition,  and  Logical  Recollecti 
on  the  ground  that  their  low  reliability  coefficients  suggest  th 
their  correlations  with  the  other  tests  do  not  give  us  an  ex* 
measure  of  the  existing  relationship,  we  have  remaining  a  series 
16  reliable  tests.  The  inter- test  correlations  based  upon  the  scoi 
in  these  16  tests  are  accurate  indicators  of  the  true  relations! 
existing  between  these  tests.  Our  conclusions  drawn  from  tin 
inter-test  correlations  are,  moreover,  strengthened  by  our  knowlec 
that  they  are  based  upon  reliable  test  scores  which  give  an  accun 
measure  of  the  freshman's  ability  in  these  tests. 


SECTION  VII 


CORRELATIONS  BETWEEN  THE  TESTS  AND 

ACADEMIC  MARKS 

TESTS  VERSUS  MARKS  AS  MEASURES  OF  MENTAL 

ABILITY 

The  charts  discussed  in  Section  V  showed  that  the  freshman 
scores  in  the  psychological  tests  were  distributed  according  to  the 
normal  probability  curve.  Tables  XXVIII  to  XXXII  inclusive, 
show  the  distribution  for  the  five  groups  of  academic  marks,  based 
on  grades  of  freshmen  in  Group  I. 

TABLE  XXVIII  TABLE  XXIX 

LANGUAGE  MATHEMATICS 

Frequency  Frequency 

2  I 

14  14 

49  33 

30  30 

2  10 


Grade 

F  (50-60) 
D  (60-70) 
C  (70-80) 
B  (80-90) 
A  (90-100) 


TABLE  XXX 

SCIENCE 
Frequency 

4 
6 

16 

12 

3 


TABLE  XXXII— HISTORY 
Frequency 
O 

4 
16 

4 

2 


TABLE  XXXI— PHILOSOPHY 

Grade  Frequency 

F   (50-60)  O 

D  (60-70)  I 

C  (70-80)  10 

B  (80-90)  12 

A  (90-100)  4 

Not  only  is  there  a  coarse  grouping  (only  five  units)  as  compared 
with  the  fine  grouping  of  scores  in  the  various  psychological  tests 
(15  to  20  units),  but  the  distributions  fail  to  follow  the  normal  error 
curve  as  is  the  case  in  the  test  scores.  With  the  academic  marks 
there  is  a  decided  skewing  of  the  distribution  curves  toward  the 
good  or  positive  end.  It  seems  as  though  instructors  made  a  delib- 
erate effort  to  avoid  failing  their  students.  As  for  the  passing  grades, 
inspection  of  the  marks  suggests  that  there  is  insufficient  care  in 
rating  students  according  to  their  relative  abilities  in  various  courses. 

Observation  of  the  uniform  surfaces  of  frequency  obtained  when 
these  one  hundred  freshmen  were  given  the  twenty-three  psycho- 
logical tests,  compared  with  the  decidedly  skewed  distributions  for 
the  same  students  in  academic  marks,  prepares  us  for  correlation 
tables  XXXIII  and  XXXIV. 
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Table  XXXIII  shows  the  correlation  between  the  scores  of  < 
the  psychological  tests  (excluding  Information),  and  the  marks 
each  of  the  five  academic  groups  for  the  freshmen  in  Group 
Language  shows  a  fair  positive  correlation  with  Mixed  Relatio 
(+  .20),  Word  Building  (+  .31),  Completion  (+  .30),  and  Vocab 
lary  (+  41),  s.  *.,  with  the  tests  in  which  the  language  factor  pc 
forms  a  significant  role.  Mathematics  shows  a  fair  positive  correl 
tion  with  Cancellation  (+  .28),  Checking  (+  .22),  tests  involvii 
simple  mathematical  processes,  and  Knox  Cube  (+  .24).  Scien 
shows  positive  correlations  with  Opposites  (+  .33),  Verb-obje 
(+  .23),  Mixed  Relations  (+  .30),  tests  involving  the  high 
thought  processes  needed  in  understanding  the  science  cours 
given  at  Barnard,  Knox  Cube  (+  .34),  a  test  involving  powers 
perception  and  observation  which  are  necessary  in  scientific  labor 
tory  work,  and  Logical  Recollection  (+  .21),  which  is  also  an  ir 
portant  factor  in  scientific  work. 

The  correlations  of  Philosophy  with  Cancellation  -+-  .37,  Woi 
Naming  (+  .29),  Knox  Cube  (+  .28)  and  Digit  Span  (+  .22)  a 
unexpected. 

TABLE  XXXIII 

Correlations  Between  Tests  and  Academic  Records 

Language  Mathematics  Science  Philosophy  Hist< 

Coordination —.12  +.05  —.03  +.03  +. 

Tapping —.16  +.01  —.10  +.15  +. 

Cancellation +.14  +.28  +.04  +.37  +. 

Checking —.01  +.22  +.06  +.10  -f. 

Color  Naming +.11  +.07  +.12  —.07  — . 

Directions +.03  —.10  —.03  —.22  -f. 

Opposites +.17  —.01  -K33  -h  .01  -f. 

Verb-Object +.04  +.03  +.23  +.17  — . 

Mixed  Relations +.20  +.01  -f.30  +  .12  -f . 

Word  Building +.31  -+-.15  +.00  —.17  +. 

Word  Naming -f.io  +.06  -f.02  -K29  + 

Knox  Cube +.18  +.24  +.34  +.28  +. 

Digit  Span +.19  +.19  +.05  +.22  + 

Word  Memory — Recollection  —  .01  —.23  —.07  —.27  — 

Word  Memory — Recognition  +.06  +.02  +.12  -f-.io  -+- 

Logical  Memory — Recollection  +.13  +.13  +.21  —.03  -f 

Logical  Memory — Recognition  —  .03  +.06  +.03  —.08  + 

Substitution  ist  Half —.08  +.11  +.09  —.19  -f 

Substitution  2nd  Half —.05  +.08  +.06  —.14  -f 

Subst it ut ion  Whole —.10  -f.u  -f.oo  —.19  + 

Completion +.30  -f.02  -f.05  +.17  + 

Vocabulary +.41  —.05  +.12  +.09  + 
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TABLE  XXXIV 
Correlation  Between  Tests  and  Intelligence  Quotient 

Intelligence 
Quotient 

Coordination -f.18 

Tapping ~KX7 

Cancellation +.22 

Checking -+-.20 

Color  Naming +.23 

Directions +.20 

Opposites +.24 

Verb-object +.23 

Mixed  Relations +.20 

Word  Building        +.22 

Word  Naming +.26 

Knox  Cube        +.22 

Digit  Span -K  16 

Word  Memory — Recollection +.14 

Word  Memory — Recognition ■+*  .17 

Logical  Memory — Recollection +.23 

Logical  Memory — Recognition +.18 

Substitution— First  Half +.27 

Substitution — 2nd  Half +.25 

Substitution— Whole +.27 

Completion +.21 

Vocabulary +.03 

History  shows  positive  correlations  with  Opposites  (+  .30), 
Word  Building  (+  .24),  Digit  Span  (+  .33),  Logical  Recollection 
(+  .40),  and  Substitution  (+  .26),  i.  e.t  with  the  tests  involving 
ability  to  memorize  logical  material  and  ability  to  perceive  rela- 
tionships between  facts — two  essentials  for  successful  performance 
in  the  required  first-year  history  course  at  Barnard. 

In  general,  then,  the  five  academic  groups  show  positive  corre- 
lation with  tests  which  we  would  expect  to  correlate  with  them. 
Table  XXXIV  gives  the  correlations  between  the  tests  and  the 
composite  score  of  all  the  academic  groups.  The  correlations  are 
all  positive,  ranging  from  +  .14  to  +  .27  (excluding  Vocabulary), 
suggesting  a  positive  relationship.  They  are,  however,  too  low  to  be 
used  for  diagnostic  purposes.  Aside  from  a  few  correlations  in  Table 
XXXIII  previously  mentioned,  the  correlations  between  the 
various  tests  and  each  of  the  five  academic  groups  are  even  less 
susceptible  to  use  for  practical  purposes. 

In  view  of  these  low  correlations  and  the  "wide  \2tt\aX\0Tv  va  wit*.- 
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lations  obtained  between  tests  and  marks  by  other  experimenter 
the  question  arises:  Do  the  academic  marks  or  the  psychologic 
tests  give  the  more  reliable  estimates  of  the  student's  ment 
ability?  The  present  writer  believes  that  the  psychological  tes 
give  the  more  adequate  measures. 

What  meager  experimental  data  there  is  relevant  to  this  questic 
of  the  reliability  of  school  marks,  corroborates  this  view.  Tl 
skewed  distributions  in  the  case  of  the  Barnard  academic  gradi 
were  indicated  before — a  fact  which  has  been  noted  by  investigatoi 
in  the  case  of  other  institutions.47 

Professor  Max  Meyer,48  making  a  statistical  study  of  all  tl 
marks  of  forty  instructors  given  during  a  period  of  five  years  at  tl 
University  of  Missouri,  found  a  striking  lack  of  uniformity  in  tl 
standards  of  grading  used.  So  striking  was  the  non-uniformit 
that  the  college  authorities  were  moved  to  establish  a  definil 
system  of  marking  in  1908,  with  the  aim  of  overcoming  the  tei 
dency  of  the  instructors  to  distribute  grades  according  to  person; 
opinion.  Following  Meyer,  a  study  of  the  distribution  of  marl 
at  the  University  of  Wisconsin  was  made  by  Dearborn,4*  and  < 
the  marks  at  Harvard  University  and  the  University  of  Califomi 
by  Foster.60  These,  and  studies  made  at  the  University  of  Chicago 
Amherst  College,  and  Columbia  University,  agreed  in  showing  tli 
same  wide  variation  in  the  standards  of  grading  employed  b 
instructors. 

Aikins  6l  found  a  slight  difference  in  the  relative  positions  assigne 
to  17  students  in  a  philosophy  class  by  the  students  themselves  0 
the  basis  of  several  ten-minute  tests,  and  the  positions  he  assigne 
them  on  the  basis  of  four  hour  tests.  Smith  gives  several  plate 
illustrating  clearly  the  great  discrepancies  and  marked  lack  < 
uniformity  in  marking  systems  at  the  University  of  Iowa.M 

Zerbe,  in  a  detailed  study  of  the  distribution  of  grades  assigne 
for  academic  work  and  those  assigned  for  shop  work  at  the  Scho 
of  Applied  Industries,  Carnegie  Institute  of  Technology,  four 
that  the  grades  as  distributed  for  the  shop  work  were  based  on 
much  lower  standard  than  the  grades  assigned  for  the  theoretic 

«7  Kelly  in  a  monograph  entitled  "Teachers'  Marks"  has  given  a  history  of  the  standards 
marking  in  elementary  schools,  high  school*,  and  colleges. 

♦•  Meyer.  Max.   The  Grading  of  Students.  Science.  28;  243-252. 

«•  Dearborn.  W.  F.   School  and  University  Grades. 

*•  Foster.  William  T.  Scientific  vs.  Personal  Distribution  of  College  Credits;  Popular  Sciet 
Monthly.  78;  378-408. 

»»  Aikins.  H.  A.    The  Reliability  of  *  Marks."  Science.  N.  S..  1010.  3*;  18-10. 

"  Smith.  A.  G.  A  Rational  College  Marking  System,  Journ.  of  EJuc.  Psychol.,  iqh,  2 ;  383-31 
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subjects."  He  also  observed  a  marked-  lack  of  conformity  to  a 
standard  in  the  case  of  grades  given  by  individual  instructors. 
When  Jones  M  gave  an  opposites  test  and  a  memory  test  to  each  of 
two  elementary  psychology  classes,  taught  by  different  instructors, 
he  obtained  these  interesting  results: 

Instructor  "A"  Instructor  *B" 

(28  students)  (33  students) 

Class  standing  and  opposites        ....  .09  .49 

Class  standing  and  memory .44  .07 

These  correlations  were  explained  when  further  investigation 
revealed  that  instructor  A  taught  by  the  outline  method,  emphasiz- 
ing the  memory  factor,  whereas  instructor  B  discouraged  verbatim 
statements  taken  from  the  text  book.  Both  instructors  were  teach- 
ing the  same  subject,  but  assigning  grades  according  to  entirely 
different  standards. 

After  an  exhaustive  study  of  the  question  at  Harvard  and  other 
institutions,  President  Foster  of  Reed  College  concluded  that 
"Not  only  are  there  extreme  variations  among  different  courses, 
but  there  are  variations  in  the  same  course  from  year  to  year  that 
cannot  be  accounted  for,  apparently,  by  any  of  our  scientific  studies 
in  the  distribution  of  abilities  among  human  beings.  From  Maine 
to  California  the  administration  of  college  credits,  although  alike 
in  no  other  particular,  agrees  in  this:  "That  its  basis  is  personal 
rather  than  scientific." M  Recognition  of  this  personal  equation 
factor  has  led  Smith,  Weiss,66  Zerbe,  Foster,  Starch,  and  other 
investigators  to  emphasize  the  need  of  a  uniform  system  of  grading. 
They  agree,  moreover,  in  maintaining  that  the  distribution  of 
college  grades,  when  properly  assigned,  should  conform  to  the 
normal  probability  curve.  In  1914,  a  committee  on  standardizing 
grades  at  George  Washington  University  made  a  similar  proposal. 
Definite  attempts  to  enforce  such  systems  of  marking  are  now 
being  used  at  the  University  of  Missouri,  Reed  College,  and  other 
institutions. 

Even  in  a  more  restricted  and  more  objective  situation  when 
instructors  are  asked  to  assign  grades  according  to  performance  in 
a  definite  task — as  for  example,  in  a  written  examination  paper, 
there  is  great  variability  due  to  the  widely  different  subjective 

M  Zerbe,  J.  L.  Distribution  of  Grades.  Journ.  of  Bduc  Psychol.,  1017.  9;  575-588. 
M  Jones,  B.  S.  A  Suggestion  for  Teacher  Measurement.    School  and  Society,  1017,  6;  321-322 . 
"  Zerbe,  J.  L.  Distribution  of  Grades. 

M  Weiss,  A.  P.  School  Grades— To  what  Type  of  Distribution  shall  they  Conform?  Science , 
10x2,  36;  403-407* 
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standards  employed  by  the  teachers  in  judging.67  Jacoby  found  a 
variation  of  1.5  points  out  of  10  in  the  grades  of  six  professors  of 
astronomy  in  marking  eleven  astronomy  papers."  Starch  and  Elliott 
had  facsimile  reproductions  made  of  two  first-year  English  papers 
and  a  geometry  paper,  printed  on  the  same  kind  of  paper  the 
students  had  written  them  on.19  These  they  then  had  rated  by 
142  high  school  teachers  of  these  two  subjects.  The  English  papers 
were  also  rated  by  a  class  in  the  Teaching  of  English  in  the  Univer- 
sity of  Wisconsin  and  by  a  Summer  School  class  of  teachers  in  the 
University  of  Chicago.  They  found  that  the  grades  assigned  to  the 
two  English  papers  by  142  English  teachers  ranged  in  the  case  of 
one  paper  from  64  to  98,  with  a  probable  error  of  4.0,  and  in  the 
case  of  the  other  from  50  to  98,  with  a  probable  error  of  4.8.  The 
grades  of  the  mathematics  paper  assigned  by  118  mathematics 
teachers  ranged  from  28  to  92,  with  a  probable  error  of  7.5  points.10 

In  a  later  investigation  Starch  had  ten  college  freshman  English 
papers  graded  independently  by  ten  instructors  of  the  various 
sections  of  freshman  English.61  He  found  as  wide  a  range  of  marks 
as  he  obtained  with  the  English  and  Mathematics  papers  of  his 
former  investigation.  Moreover,  when  ten  papers  were  regraded  by 
the  same  instructor  after  a  certain  interval  of  time,  Starch  found 
an  average  difference  between  the  first  and  second  grading  of  4.4 
points.  He  also  found  a  mean  variation  of  the  grades  assigned  by 
teachers  in  different  schools  of  5.4  points,  by  teachers  in  the  same 
department  and  institution  of  5.3  points,  and  of  grades  assigned  at 
different  times  by  the  same  teachers  to  their  own  papers  of  2.2 
points.  On  the  basis  of  all  his  data,  he  concluded  that  the  best 
marking  scale  is  100,  95,  90,  85,  80,  etc.,  and  that  the  distribution 
of  grades  should  follow  the  probability  curve. 

All  the  studies  thus  far  made  in  this  field  indicate  this  same 
variation  in  standards  of  grading.  There  are,  moreover,  additional 
factors  which  render  school  marks  absolutely  unreliable  measures 
of  a  student's  mental  ability,  and  cause  low  correlations  between 
psychological  tests  and  marks. 

"  For  illustrations  of  the  variability  of  Civil  Service  examiners  in  rating  the  same  papers,  the 
variation  between  the  marks  of  teachers  in  New  York  State  on  the  one  hand,  and  the  Regents  on 
the  other,  see  Kelly's  monograph. 

*'  Jacoby.  H.  The  Marking  System  in  the  Astronomical  Course  at  Columbia  College,  1900-  1910, 
Science,  31;  819. 

*•  Starch  and  Elliott,  Reliability  of  Grading  High  School  Work  in  English.  School  Review, 
September,  191  ■*• 

••Starch  and  Elliott,  School  Review,  21,  254-259. 

•l  Starch,  D.  The  Reliability  and  Distribution  of  Grades,  Science,  1913,  38;  630-636. 
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James,  from  work  done  at  Whitewater  Normal  School,  gives 
these  three  reasons  for  the  low  correlations  obtained  by  him: w 

"i.  The  reluctance  of  nearly  all  teachers,  and  their  inability 
because  of  the  limitations  of  our  poor  rating  methods,  to  rate  the 
good  students  as  high  as  they  should  be  rated,  or  the  poor  ones  as 
low  as  they  should  be  rated." 

u2.  The  rather  closer  application  to  their  studies  made  by  the 
less  able,  due  to  greater  anxiety  and  more  time  at  their  disposal." 

"3.  The  easy-going  satisfaction  displayed  by  many  able  minds 
content  with  what  is  for  them  mediocre  accomplishment,  and  the 
greater  drain  on  their  time  imposed  by  fellow-students  for  outside 
activities  of  all  kinds." 

From  data  obtained  from  a  questionnaire  sent  to  127  delinquent 
college  freshmen  and  to  their  high  school  principals,  Miner  con* 
eluded  that  such  traits  as  "lack  of  purpose,  laziness,  and  lack  of 
resistance  to  social  and  other  distractions"  often  explain  a  student's 
failure  in  school  work.6*  Their  marks  in  such  cases  are  unreliable 
measures  of  their  ability.  Scott  manifested  agreement  with  Miner 
when  he  stated  that:  "Where  students  stood  high  in  the  tests,  but 
low  or  medium  in  estimates,  their  failure  to  succeed  in  class  work 
was  usually  due  to  laziness,  timidity,  or  disgust  for  the  idea  of 
struggling  for  marks."  M 

Abundant  statistical  evidence,  therefore,  supports  our  conten- 
tion that  the  striking  lack  of  uniformity  in  standards  of  grading 
among  instructors,  making  for  skewed  distributions  of  marks,  the 
differences  in  grades  assigned  the  same  paper  by  teachers  at  dif- 
ferent times,  the  personal  equation  in  marking,  the  tendency  of 
many  able  students  to  neglect  studies  for  outside  distractions  and 
of  poorer  students  to  apply  themselves  more  assiduously,  the  role 
played  by  such  factors  as  lack  of  purpose  or  incentive,  interest  in 
outside  or  in  college  activities,  economic  pressure  causing  students 
to  devote  much  time  to  earning  money,  etc.,  make  college  marks 
totally  inadequate  measures  of  Students'  ability.  All  these  factors 
are  influential,  moreover,  in  making  Barnard  marks  as  unreliable 
as  marks  given  in  other  colleges.  No  attempt  is  made  by  Barnard 
instructors  to  distribute  their  grades  according  to   the  normal 

"James,  B.  B.  Mutual  Correlations  of  Intelligence,  Scholarship,  and  Vocabulary.  School  & 
Society,  1919,  9;  427.  In  School  &  Society,  1918,  7;  238-2391  James  gives  similar  factors  as 
influencing  the  correlations  between  marks  and  tests. 

•  Miner,  J.  B.  The  College  Laggard.  Journ.  of  Educ.  Psychol,  19x0, 1;  263-271. 

M  Scott,  C  A.  General  Intelligence  or  "School  Brightness."  Journ.  of  Educ  Psychol.,  1913* 
4;  509-524* 
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probability  curve.  Absolute  freedom  is  permitted  the  teachers 
As  a  result,  the  personal  bias  of  the  teachers  plays  a  large  part  it 
the  marks  received  by  students.  This,  combined  with  the  con- 
tributory causes  above  mentioned,  renders  Barnard  marks  untrust- 
worthy. 

The  psychological  tests,  on  the  other  hand,  have  much  to  recom- 
mend them  as  giving  reliable  estimates  of  freshmen's  mental 
ability.  All  the  tests  employed  are  standard  tests.  They  were 
moreover,  administered  by  one  experimenter  according  to  a  care- 
fully standardized  method  of  procedure.  All  conditions  were  kepi 
constant — the  place  of  testing,  the  attitude  of  the  experimenter 
the  method  of  conducting  the  tests,  and  the  method  of  scoring 
Every  student  undertook  the  examination  with  a  determination  tt 
do  her  level  best.  Whereas,  in  school  subjects,  lack  of  interest  01 
incentive  often  caused  a  girl  to  do  a  lower  grade  of  work  than  shi 
was  mentally  capable  of  doing,  here  there  was  a  definite  incentivi 
impelling  her  to  exert  maximum  effort.  Each  freshman  expectec 
to  receive  vocational  guidance  based  on  her  test  scores.  She  accord- 
ingly took  the  psychological  test  at  an  hour  convenient  for  her— 
when  she  was  feeling  in  good  condition.  Genuine  interest  in  tin 
tests,  (noted  in  the  case  of  all  students),  coupled  with  a  keen  desirt 
to  make  a  favorable  record,  renders  their  test  scores  reliable  esti 
mates  of  their  ability.  The  fact  that  the  scores  conform  to  norma 
distribution  curves  further  indicates  the  reliability  of  these  measures 

We  do  not  claim,  however,  that  we  can  predict  a  student': 
future  success  in  college  from  her  psychological  test  record.  Thi 
psychological  examination  gives  an  adequate  measure  of  wha 
each  freshman  can  do.  From  it  we  can  make  an  authentic  psycho 
graph  of  her  mental  abilities  indicating  in  which  processes  she  i 
strong,  and  in  which  she  is  weak.  Whether  she  will  make  hig) 
academic  grades  or  attain  success  in  later  life  depends  not  on); 
upon  her  mental  capacity,  but  upon  such  other  factors  as  interest 
incentive,  will-power,  economic  stress,  environmental  condition! 
etc.  The  tests,  not  her  academic  marks,  measure  her  mental  capac 
ity;  to  predict  her  future  performance  in  school  or  her  success  i 
a  particular  vocation,  we  must  also  consider  these  other  factors. 


SECTION  VIII 

CORRELATIONS  BETWEEN  PSYCHOLOGICAL  TESTS 
AND  PHYSICAL  MEASUREMENTS.  THEIR 

SIGNIFICANCE 

There  is  one  further  problem  to  be  considered — the  relation 
existing  between  the  psychological  tests  and  the  physical  measure- 
ments. The  correlations  shown  in  Table  XXXIII,  based  on  the 
records  of  the  one  hundred  freshmen  in  Group  I,  furnish  an  im- 
portant contribution  to  our  existing  meagre  data  on  this  subject. 

Most  investigators  who  have  hitherto  reported  correlations 
between  physical  traits  and  mental  ability  have  used  school  marks 
or  teachers'  estimates  as  indicators  of  mental  ability.  Their  sub- 
jects, moreover,  have  been  school  children.  Porter,  Smedley, 
De  Buck,  MacDonald,  Gilbert,  Baldwin,  Pyle,  King,  Arnold, 
Wilson,  and  Schuyten  are  some  of  the  chief  workers  in  this  field. 
Widely  varying  results  have  been  reported,  some  experimenters 
finding  positive  correlations  between  physical  traits  and  school 
progress,  others  negative,  and  still  others  indifferent  or  zero  corre- 
lations. Discussing  the  significance  of  these  varying  correlations, 
Whipple  says:  "The  trend  of  evidence  is  to  the  effect  that  all  such 
correlations,  where  found,  are  largely  explicable  as  phenomena  of 
growth,  i.  e.t  as  correlations  with  relative  maturity.  This  makes 
intelligible  the  fact  that,  in  general,  the  positiveness  of  all  such 
correlations  lessons  with  age,  and  that  many  of  them,  indeed, 
become  difficult  or  impossible  of  demonstration  in  adults." w 

Of  the  investigations  in  which  adults  have  been  used  as  subjects, 
the  work  of  Dr.  Karl  Pearson  is  perhaps  the  most  extensive.  He 
made  measurements  of  1,000  Cambridge  University  students, 
obtaining  these  correlations: 

Mental  ability  and  dolichocephaly  .  .     .    +.03        ^.03 

Mental  ability  and  short  heads  —  .08        ±.03 

Mental  ability  and  broad  heads       .  +.04       ^.03 

His  method  of  rating  his  subjects  for  mental  ability  was  extremely 
rough,  consisting  merely  in  grouping  the  men  into  two  big  classes — 
pass  men  and  honor  men.  Similar  correlations  obtained  by  Pearson 
between  head  measurements  and  mental  ability  as  measured  by 

•  Whipple,  G.  M.  Manual  of  Mental  and  Physical  Testa.  Part  I,  p.  71* 
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teachers  in  the  case  of  1856  school  boys  twelve  years  of  age,  lead 
Galton  to  conclude  "that  there  is  no  marked  correlation  between 
ability  and  shape  or  size  of  the  head."  * 

In  another  investigation  with  Cambridge  students,  Pearson 
found  zero  correlations  between  mental  ability,  determined  roughly 
as  indicated  above,  and  strength  of  pull,  strength  of  squeeze,  long 
sight,  weight,  and  ratio  of  weight  to  stature.67  Continued  testing 
of  Cambridge  students  and  school  children  lead  Pearson  to  conclude 
in  1906  that  The  results  (of  our  investigations)  confirm  the  previous 
conclusion  that:  While  there  exists  a  slight  but  sensible  relation 
between  size  of  head  and  intelligence,  there  is  no  possibility  of 
using  this  relation  to  make  even  rough  individual  predictions.'9  a 

These  investigations,  although  interesting,  have  no  direct  bear- 
ing upon  our  problem,  however,  which  is  concerned  with  the  rela- 
tionship existing  between  the  performance  of  college  freshmen  in 
psychological  tests  and  their  physical  measurements  taken  in  the 
gymnasium. 

We  have  good  reason  to  feel  that  these  physical  measurements  are 
fully  as  reliable  and  accurate  estimates  as  are  the  psychological  test 
scores.  The  physical  examinations  were  all  conducted  in  the 
Thompson  Gymnasium  of  Teachers  College.  They  were  given 
individually,  the  head  of  the  Department  of  Physical  Education 
of  Barnard  College  making  all  the  measurements.  These  were  then 
immediately  recorded  on  the  student's  physical  record  card  by  an 
assistant.  Thus  any  inaccuracy  in  taking  the  measurements  would 
be  a  constant  one,  and  would  not  disturb  the  relative  ranking  of  the 
freshmen. 

Experimental  conditions  were  as  uniform  as  in  the  case  of  the 
psychological  tests.  Each  girl  came  to  the  gymnasium  at  an  hour 
convenient  for  her  and  went  through  all  parts  of  the  examination 
according  to  a  standardized  method  of  procedure.  No  clothing  was 
worn  during  the  examination,  save  for  two  light  cloth  flaps  which 
were  fastened  loosely  about  the  shoulders  by  means  of  a  draw 
string  and  two  similar  flaps  fastened  about  the  waist  which  could 
easily  be  raised  in  taking  measurements.  These  were  provided  by 
the  physical  director  for  the  occasion. 

■  Pearson.  K.  On  the  Correlation  of  Intellectual  Ability  with  the  Sixe  and  Shape  of  the  Head. 
Proc.  Roy.  Soc.  iooi.  LXIX,  333*342. 

•7  Lee.  A..  Lewenz,  M.  A.,  and  Pearson,  K.  On  the  Correlation  of  the  Mental  and  the  Physical 
Characters  in  Man.  II  Proc.  Roy.  Soc.,  1002.  LXXI,  106-114. 

M  Pearson.  K.  On  the  Relationship  of  Intelligence  to  Size  and  Shape  of  Head,  and  to  other 
Physical  and  Mental  Characters.    Biometrika.  1006.  s;  105-146. 
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The  physical  records  taken  were:  height  measured  in  centi- 
meters with  a  stadiometer;  weight,  measured  in  pounds  with  the 
Fairbanks  scale;  lung  capacity,  measured  in  cubic  centimeters;  and 
four  other  strength  tests — grip  right  and  left  hand,  upper  back  and 
chest,  measured  in  kilograms  with  a  dynamometer.  The  norms  for 
these  measurements  obtained  for  these  one  hundred  freshmen  were 
given  in  Section  V. 

The  curves  of  distribution  for  these  seven  measurements  (which 
lack  of  space  prevents  us  from  printing),  conform  approximately 
to  the  normal  probability  curve.  The  subjects,  moreover,  with  a 
very  few  exceptions,  were  all  eighteen  years  of  age  or  over,  so  that 
the  factor  of  relative  maturity  does  not  affect  the  correlations.  The 
freshmen  are  a  rather  homogeneous  group  with  respect  to  age. 
These  facts,  coupled  with  the  accuracy  of  both  the  physical  and 
psychological  measures  give  us  good  reason  to  believe  in  the  reliabil- 
ity of  the  correlations  in  Table  XXXIII. 

It  is  interesting  to  note  that  six  of  the  seven  physical  measure- 
ments— all  except  lung  capacity — manifest  zero  or  chance  correla- 
tions with  all  the  psychological  tests.  The  average  correlation  of 
each  of  these  six  measures  with  all  the  psychological  tests  is  as 
follows:  Height  with  all  the  tests,  +  .05;  weight  +  .06;  strength 
of  grip,  right  hand,  +  .04;  strength  of  grip,  left  hand,  +  .02; 
strength  of  upper  back,  +  .02,  and  strength  of  chest,  +  .05.  As 
these  correlations  are  all  less  than  the  probable  error  ( ±  .068) 
they  indicate  cjearly  that  there  is  no  connection  between  these 
physical  measurements  and  a  freshman's  mental  ability  as  indicated 
by  her  psychological  test  records.  In  the  case  of  lung  capacity,  all 
the  correlations  (except  with  vocabulary)  are  positive.  They  are 
markedly  low,  though,  the  average  correlation  between  lung  capac- 
ity and  all  the  psychological  tests  being  only  +  .10.  This  is  little 
more  than  the  probable  error,  indicating  the  existence  of  only  a 
chance  relationship. 

The  uniformity  of  the  single  correlations  in  exhibiting  this 
tendency  toward  chance  relationship  is  significant.  In  only  eight 
cases  out  of  the  total  number  of  154  correlations,  or,  in  fact,  we 
might  say  in  only  six  cases,  since  the  correlations  between  Substitu- 
tion First-half  and  lung  capacity  (+  .20)  and  Substitution  Second- 
half  and  lung  capacity,  (+  .26)  duplicate  information  yielded  by 
the  correlation  between  Substitution  Whole  and  lung  capacity 
(+  .24) — are  there  correlations  of  +  .20  or  over.  The  highest 
correlation  is  only  +  .26  (Substitution  Second-half  and  lung  capac- 
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ity),  which  is  too  low  to  admit  of  diagnostic  purposes.  With  the 
few  exceptions,  all  the  correlations  betweeff  physical 
and  the  tests — 146  correlations  in  aft— show 
relationship.   The  large  number  of  these  correlations 
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TABLE  XXXV 

COKJULATIONS  BSTWBBN  TBSTS  AMD  PHYSICAL  MBASUSBiaDRS 


1.  Coordination 

2.  Tipping 

3.  Cancellation  . 

4.  Checking  .     . 

5.  Color  Naming 

6.  Direction* 

7.  Oppoaitea 

8.  Verb-object    . 

9.  Mixed  Relation* 

10.  Word  Building 

11.  Word  Naming 

12.  Knox  Cube  . . 

13.  Digit  Span 

14.  Word  Memory — Recollection 

15.  Word  Memory — Recognition 

16.  Logical     Memory  —  Recol- 

lection    

17.  Logical    Memory — Recogni- 

tion   

18.  Substitution — First  Half 

19.  Substitution — 2nd  Half  . 

20.  Substitution — Whole 

21.  Completion     .... 

22.  Vocabulary     .... 

Average 


+.18   +.22    +.22    —.05   +.01    -Kio   +.< 


+.09 

+.10 

+.17 

+.19 
—.12 

—.02 


+.11 
+.05 
—.02 

+.00 

-.05 

+.07 


+.14 
+.20 
+.26 

+.24 
+.04 
-.17 


+.05   +.06   +.10 


-.05 
+.02 

+.05 

+.04 

—.02 

+.07 

+.04 


+.04 
+.07 
+  07 
+.07 
-.05 
-.05 

+.01 


—  .01 
—.00 
+.09 
+.06 
+.02 
-.04 

-f.oi 


+. 


in  concluding  that  the  relationship  between  the  physical  measur 
and  the  tests  is  one  of  chance  only. 

It  is  interesting  to  know  that  the  only  other  experimenter  wl 
has  reported  the  results  of  a  similar  study  with  college  freshnu 
supports  this  view.  Although  Wissler  in  his  study  of  the  results 
the  old  Columbia  freshman  tests  reports  only  two  correlatioi 
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between  the  physical  tests  and  the  psychological  tests — namely,  a 
correlation  between  length  of  head  and  logical  memory  of  +  .21, 
and  between  breadth  of  head  and  logical  memory  of  —  .05 — the 
observation  of  the  records  of  freshmen  in  other  physical  tests  com- 
pared with  their  records  in  the  psychological  tests  lead  Wissler  to 
conclude:  "That  the  physical  tests  show  a  general  tendency  to  corre- 
late among  themselves,  but  only  to  a  very  slight  degree  with  the 
mental  tests."  •• 

Although  the  physical  measurements  exhibit  only  a  chance 
connection  with  a  freshman's  psychological  test  score,  they  should 
be  taken  into  consideration  by  an  instructor  or  advisor  whose  duty 
it  is  to  give  guidance  to  a  student  in  planning  her  college  course. 
In  Section  V  we  pointed  out  the  case  of  a  freshman  (Chart  3,  G.S.), 
whose  net  score  in  the  psychological  examination  was  well  above 
the  average  freshman  record,  but  whose  standing  in  academic  work 
was  in  the  lowest  quintile  of  the  class.  The  fact  that  she  made  the 
best  record  in  the  class  in  the  physical  measurements,  together  with 
the  information  we  later  acquired  concerning  her  athletic  activities, 
explained  her  academic  failure.  The  more  varied  measures  of  a 
student  we  have,  the  better  qualified  we  will  be  to  make  an  adequate 
psychograph  of  a  student's  relative  abilities  and  disabilities,  in 
various  lines. 

M  Wiaalcr,  Clark.  Psychological  Review  Monograph  Supplement,  June.  xooi. 


GENERAL  SUMMARY  OF  THE  RESULTS  WITH 
SUGGESTIONS  FOR  THE  PRACTICAL  USE 

OF  THE  TESTS 

A  series  of  nineteen  psychological  tests  was  given  to  two  groi 
of  one  hundred  Barnard  freshmen  each  with  the  aim  first  of  est 
lishing  norms  and  standards  of  performance  and  giving  student 
clear  conception  of  their  abilities  and  aptitudes  along  various  li: 
and  second  of  determining  the  reliability  of  the  tests  and  tl 
J  correlations  with  freshmen  university  grades  and  physical  measu 

ments. 

All  the  tests  were  given  individually  according  to  a  standardu 
ii  method  of  procedure  and  under  standard  conditions. 

The  averages  and  surfaces  of  distribution  for  the  first  group 
-  one  hundred  freshmen  (Group  I)  are  approximately  the  same 

I  for  the  second  group  of  one  hundred  (Group  II)  and  for  a  th 

}  group  of  forty-five  freshmen — showing  that  Barnard  freshmen  \ 

a  homogeneous  group,  differing  little  from  year  to  year. 

The  inter-test  correlations  range  from  +  .77  (between  Cancel 
tion  and  Digit  Span)  to  .00  (between  Tapping  and  Word  Recoil 
tion  and  between  Mixed  Relations  and  Word  Recollection).  1 
positive  correlations  between  Cancellation  and  the  other  te 
(  +  .03  to  +  .77)  contradict  the  old  compensation  theory.  The  f 
that  the  correlations  are  all  positive  is  suggestive  of  a  defin 
relationship  between  Cancellation  and  these  various  tests. 

Checking  and  Word  Naming  show  the  highest  average  corn 
tion  (  +  .25)  with  the  other  tests  (omitting  Information,  Vocal 
lary,  Word  Recollection  and  Word  Recognition);  then,  in  ond 
Opposites;  Verb-object  and  Cancellation;  Color  Naming;  Dii 
tions,  Mixed  Relations,  Word  Building,  and  Completion;  Logi 
Recollection  and  Substitution  Whole;  Knox;  Tapping  and  Di 
Span;  Coordination;  Logical  Recognition. 

On  the  whole,  the  inter-test  correlations,  although  mostly  p< 
tive,  are  low,  indicating  that  we  are  testing  different  mental  abilit 
On  the  basis  of  the  relationship  shown  by  the  correlation  coc 
cients  we  may  divide  the  tests  into  three  groups:  (1)  motor  tc 
(Coordination  and  Tapping);  (2)  tests  involving  powers  of  p 
ception  and  comprehension  (Cancellation;  Checking,  Color  Na 
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ing,  Word  Naming  and  Substitution);  (3)  tests  involving  associa- 
tive relations  (Directions,  Opposites,  Verb-object,  Mixed  Rela- 
tions, Word  Building  and  Completion);  (4)  tests  which  call  into 
play  powers  of  learning,  viz.,  observation  and  retention — (Word 
Memory  and  Logical  Memory);  (5)  tests  depending  on  the  sub- 
ject's knowledge  more  than  on  her  innate  ability  (Information  and 
Vocabulary) ;  (6)  miscellaneous  group  (Digit  Span  and  Knox  Cube). 
There  is  only  a  chance  correlation  between  Information  and  Vocabu- 
lary and  the  other  tests.  With  the  exception  of  this,  group  and 
Digit  Span  and  Knox  Cube,  the  remaining  groups  of  tests  correlate 
closely  among  themselves  but  loosely  with  the  other  tests. 

There  is  no  evidence  from  these  results  of  a  general  common 
factor  nor  of  a  hierarchial  arrangement  of  the  correlations. 

The  tests  within  each  group  seem  to  be  closely  related  to  each 
other  because  they  possess  elements  in  common — elements  serving 
to  bind  them  closely  to  each  other  but  loosely  to  tests  without 
their  own  groups. 

The  coefficients  of  correlation  corrected  for  attenuation  are  con- 
siderably higher  than  the  raw  correlations  but  show  in  general 
the  same  relationships. 

The  coefficients  of  reliability  are  low  for  Word  Recollection 
(+  .18),  Word  Recognition  (+  .33)  and  Logical  Recollection 
(+  .48).  For  the  other  tests  they  range  from  +  .88  (Checking 
and  Color  Naming)  to  +  .60  (Cancellation  and  Mixed  Relations). 
We  have,  thus,  a  series  of  sixteen  reliable  tests.  Inter-test  correla- 
tions based  upon  the  scores  in  these  sixteen  tests  are  accurate 
indicators  of  the  true  relationship  existing  between  these  tests. 

The  psychological  tests  show  low  correlations  both  with  each  of 
five  academic  groups  (1)  Language,  (2)  Mathematics,  (3)  Science, 
(4)  Philosophy  and  (5)  History,  and  with  the  composite  score  of 
all  the  academic  marks  (+  .14  to  +  .27). 

Lack  of  uniformity  in  standards  of  grading  among  instructors, 
causing  skewed  distribution  curves  of  marks,  the  personal  equation 
in  marking,  the  role  played  by  such  factors  as  lack  of  incentive, 
interest  in  outside  or  college  activities,  economic  pressure,  etc., 
make  college  marks  inadequate  measures  of  the  students'  ability. 

There  is  evidence  that  the  psychological  tests  give  a  true  estimate 
of  each  freshman's  mental  capacity.  To  predict  her  performance  in 
school  or  in  a  future  vocation  both  her  capacity  and  such  other 
factors  as  interest,  incentive,  will-power,  environmental  conditions, 
etc.,  must  be  considered. 
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The  correlations  between  the  physical  measurements  and 
psychological  tests  show  approximately  zero  or  chance  relations!) 
Psychographic  charts  may  be  constructed,  showing  each  stud* 
her  relative  rank  in  the  tests,  academic  grades  and  physical  measu 
ments.  Such  psychographs  may  be  put  to  practical  use  as 
example,  in  cases  where  a  student  is  doing  academic  work  of  a  gra 
!|  below  the  level  her  test  record  showed  her  capable  of. 

t  The  results  of  this  investigation  make  it  possible  to  offer  a  f 

•|  tentative  suggestions  to  college  administrators  who  desire  to  ins 

Ij  tute  a  system  of  student  guidance.   The  first  step  in  such  a  pi 

i  might  well  be  to  put  each  member  of  the  freshman  class  throu 

i  a  thorough  physical  examination  to  determine  her  physical  fitn 

!  for  undertaking  college  work.    This  examination  should  be  ma 

by  the  director  of  the  Physical  Education  department  or  a  co 

petent   assistant   in   the  department.    Students  with   correctil 

i;  physical  defects  should   be  given   proper   treatment — eyeglass 

special  physical  exercises  or  what  not,  according  to  their  nee 
,  Those  suffering  from  a  slightly  run  down  condition  might  be  advis 

'  to  take  a  light  program  until  they  regained  their  normal  conditio 

'  those  too  far  below  par  might  be  advised  not  to  enter  college. 

The  second  step  might  be  to  obtain  an  estimate  of  her  men 
capacity  on  the  basis  of  her  score  in  a  psychological  examinatk 
A  psychologist  (who  might  also  act  as  vocational  advisor)  with 
assistant  might  well  be  in  charge  of  this  work.  If  possible,  ea 
freshman  should  be  tested  individually,  the  same  experimen 
conducting  all  the  tests  according  to  a  standard  method  of  pi 
cedure.  As  for  the  particular  tests  to  be  used,  they  should 
varied  in  character,  adapted  to  measure  various  mental  abiliti 
A  series  that  may  be  divided  into  several  groups,  each  group  testi 
a  rather  definite  mental  ability  and  such  that  tests  within  ea 
group  correlate  highly  among  themselves  but  loosely  with  all  te 
outside  their  own  group,  as  in  the  present  investigation — perh< 
represents  the  ideal  type  of  tests.  The  particular  series  of  te 
employed  in  this  study  is  not,  however,  recommended  as  the  b 
series  of  tests  that  might  be  used.  It  is  very  probable  that  a  ser 
could  be  found  that  will  test  more  significant  mental  abilities  a 
such  that  the  tests  within  each  group  will  correlate  more  clos< 
with  each  other  and  more  loosely  with  other  tests.  Only  by  empi 
cally  trying  out  different  series  can  the  ideal  series  be  found. 

Where  lack  of  time  or  the  size  of  the  freshman  class  makes 
impossible  to  test  each   freshman   individually,  a  comprehensi 
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group  test  that  has  been  found  successful — as  for  example,  the 
Army  Alpha  or  the  Thorndike  Group  test — may  be  employed. 
In  view  of  the  successful  results  secured  with  these  group  tests 
and  the  speed  with  which  they  may  be  administered,  it  may  well 
be  that  such  a  comprehensive  group  test  as  the  Thorndike  test 
would  be  the  best  to  employ.  In  the  case  of  students  who  barely 
passed  or  who  failed  in  this  group  test,  such  a  series  of  tests  as  that 
used  in  the  present  investigation  might  be  used  to  supplement  the 
results  of  the  group  test.  It  would  seem  that  a  group  test  which 
might  be  supplemented,  where  necessary,  by  an  individual  examina- 
tion would  be  the  ideal  arrangement. 

As  we  stated  before,  a  psychologist  and  an  assistant  should  pref- 
erably be  in  charge  of  the  psychological  testing.  Perhaps  a  group 
of  fifteen  to  twenty  persons  with  some  experience  in  scoring  psy- 
chological tests  might  be  employed  to  score  the  tests  immediately 
after  the  psychologist  has  given  them.  In  this  way  the  examinations 
might  be  easily  scored  within  three  or  four  days  and  the  reports 
made  out  for  each  student  very  soon  after.  The  results  of  the 
psychological  examination  and  the  physical  examination  together 
with  the  student's  academic  entrance  record,  might  then  be  sub- 
mitted to  the  psychologist  or  vocational  advisor.  On  the  basis  of 
these  records,  psychographic  charts  might  be  made  out  for  each 
student  indicating  her  strengths  and  weaknesses.  The  vocational 
advisor  might  then  have  an  immediate  interview  with  such  stu- 
dents who  showed  any  marked  disabilities.  In  this  personal  con- 
ference the  advisor  might  try  to  obtain  from  the  student  pertinent 
information  concerning  her  interests,  economic  status,  environ- 
mental conditions,  etc.  All  these  supplementary  items  of  informa- 
tion would  then  enable  him  to  form  a  comprehensive  idea  of  the 
student's  mental  and  moral  calibre.  With  this  as  a  basis  vocational 
advice  could  be  given  the  student  regarding  her  choice  of  subjects, 
study  habits,  participation  in  extra  curricula  activities,  etc.  Per- 
haps such  students  might  be  asked  to  report  at  stated  intervals  for 
further  conference.  Much  the  same  procedure  might  be  followed 
with  the  other  students  except  that  here  fewer  conferences  would 
be  necessary. 

The  advisor  should  be  free  to  devote  all  his  time  to  supervising 
the  academic  career  of  the  students  and  to  rendering  needed  advice. 
Obviously  such  a  man  should  be  a  psychologist  with  both  ability 
to  interpret  the  various  measures  secured  of  each  student's  ability 
and  tact  in  persuading  students  to  follow  his  suggestions.  From  the 
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attempts  that  have  thus  far  been  made  in  certain  institutions  U 
guide  students'  academic  careers,  it  seems  probable  that  with  ai 
able  vocational  advisor  aided  by  a  competent  assistant  such  a  sys 
tern  would  be  a  distinct  help  in  stimulating  students  to  exert  maxi 
mum  effort  in  doing  their  college  work. 


